-- Logs begin at Fri 2022-09-09 19:48:45 UTC, end at Fri 2022-09-09 20:47:51 UTC. -- Sep 09 20:19:13.053731 dv-cinder-849325-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 20:19:13.061108 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 20:19:13 2022] *** Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: nodename: dv-cinder-849325-4-iscsi Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: machine: x86_64 Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: clock source: unix Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: pcre jit disabled Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: detected number of CPU cores: 4 Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: current working directory: / Sep 09 20:19:13.063685 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: detected binary path: /usr/bin/uwsgi-core Sep 09 20:19:13.064380 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: your processes number limit is 47680 Sep 09 20:19:13.064380 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: your memory page size is 4096 bytes Sep 09 20:19:13.064380 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: detected max file descriptor number: 2048 Sep 09 20:19:13.064380 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: lock engine: pthread robust mutexes Sep 09 20:19:13.064380 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: thunder lock: enabled Sep 09 20:19:13.064380 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 20:19:13.064380 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 20:19:13.103327 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: Python main interpreter initialized at 0x56360ed229c0 Sep 09 20:19:13.103327 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: python threads support enabled Sep 09 20:19:13.103327 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: your server socket listen backlog is limited to 100 connections Sep 09 20:19:13.103327 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: your mercy for graceful operations on workers is 90 seconds Sep 09 20:19:13.103653 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 20:19:13.103722 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: *** Operational MODE: preforking *** Sep 09 20:19:13.103984 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: *** uWSGI is running in multiple interpreter mode *** Sep 09 20:19:13.103984 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: spawned uWSGI master process (pid: 105449) Sep 09 20:19:13.104169 dv-cinder-849325-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 20:19:13.105901 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: spawned uWSGI worker 1 (pid: 105450, cores: 1) Sep 09 20:19:13.105901 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: spawned uWSGI worker 2 (pid: 105451, cores: 1) Sep 09 20:19:13.105901 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 20:19:13.759579 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 20:19:13.760177 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 20:19:14.836162 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:19:14.836162 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: from cryptography.utils import int_from_bytes Sep 09 20:19:14.836826 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:19:14.836826 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: from cryptography.utils import int_from_bytes Sep 09 20:19:14.841124 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:19:14.841124 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: from cryptography.utils import int_from_bytes Sep 09 20:19:14.841608 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:19:14.841608 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: from cryptography.utils import int_from_bytes Sep 09 20:19:17.323970 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:19:17.324550 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:19:17.324730 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:19:17.325085 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:19:17.325359 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:19:17.325729 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:19:17.326110 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.326206 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:19:17.326295 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.326388 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.326504 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:19:17.326648 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.326867 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:19:17.326975 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.327124 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:19:17.327283 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.328022 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.328130 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.328352 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.328451 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.328676 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.328760 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.328996 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.329088 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.329337 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.329503 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.329651 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.329751 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-4-iscsi {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.329968 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.330071 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.330268 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.330357 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.330575 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.330679 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.330844 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.330937 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.331160 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.331255 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.331479 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.331576 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-4-iscsi {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.331780 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.331866 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.332092 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.332267 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.332385 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.332690 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.332787 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.332994 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.333100 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.333335 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.333447 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.333648 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.333804 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.333963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.334146 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.334287 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.334456 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.334576 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.334762 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.334896 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.335071 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.335194 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.335419 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.335556 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.335729 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.335862 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-4-iscsi {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.336040 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.336174 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.336361 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.336492 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.336667 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.336803 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.336991 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.337140 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.337310 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.337437 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.337706 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-4-iscsi {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.337850 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.338022 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.338237 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.338365 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.338496 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.338621 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.338750 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.338942 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.339068 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.339260 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.339396 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.339575 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.339715 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.339890 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.340024 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.340188 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.340331 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.340492 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.340626 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.340787 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.340918 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.341093 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.341221 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.341419 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.341556 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.341721 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.341856 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.341989 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.342121 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.342246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.342395 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.342559 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.342687 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.342875 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.343028 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.343766 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.343897 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344025 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344164 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344295 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344425 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344548 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344676 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344854 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.344990 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.345159 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.345326 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.345479 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.345674 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.345812 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.345937 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.346070 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.346278 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.346405 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.346527 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.346660 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.346783 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.346936 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.347062 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.347239 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.347366 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.347554 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.347681 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.347864 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.348005 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.348184 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.348320 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.348488 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.348615 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.348796 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.348930 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.349104 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.349267 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.349451 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.349579 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.349755 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.349880 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.350076 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.350210 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.350386 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.350513 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.350688 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.350811 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.351004 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.351139 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.351324 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.351459 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.351629 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.351754 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.351931 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.352064 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.352235 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.352360 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.352554 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.352680 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.352875 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.353000 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.353172 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.353313 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.353436 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.353569 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.353726 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.353934 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.354068 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.354191 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.354314 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.354437 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.354620 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.354748 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.354923 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.355051 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.355227 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.355346 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.355524 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.355666 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.355860 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.355986 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.356109 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.356258 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.356454 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.356587 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.356713 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.356837 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.356986 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.357126 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.357309 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.357438 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.357613 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.357752 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.357916 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.358122 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.358249 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.358373 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.358496 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.358619 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.358847 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.358983 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.359156 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.359283 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.359459 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.359585 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.359762 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.359892 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.360065 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.360191 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.360366 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.360500 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.360683 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.360823 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.360985 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.361110 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.361323 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.361462 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.361632 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.361768 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.361940 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.362069 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.362247 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.362375 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.362566 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.362701 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.362869 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.363006 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.363173 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.363299 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.363486 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.363613 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.363782 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.363930 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.364119 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.364244 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.364454 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.364579 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.364703 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.364833 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.364957 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.365081 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.365285 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.365427 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.365552 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.365683 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.365909 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.366055 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.366192 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.366316 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.366461 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.366645 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.366771 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.366904 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.367028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.367159 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.367296 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.367420 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.367592 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.367733 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.367895 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.368028 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.368198 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.368326 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.368498 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.368637 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.368796 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.368921 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.369112 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.369238 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.369460 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.369602 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.369770 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.369896 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.370078 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.370205 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.370382 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.370510 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.370702 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:19:17.370829 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.371028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.371154 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.371340 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.371471 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.371652 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.371779 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.371978 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.372105 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.372285 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.372414 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.372593 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.372721 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.372902 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.373042 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.373217 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.373389 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.373553 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.373692 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.373881 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.374017 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.374198 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.378685 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.378685 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.378878 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.378959 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379038 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379131 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379220 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379301 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379381 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379381 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379535 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379617 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379695 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379773 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379851 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.379851 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380006 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380087 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380166 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380243 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380321 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380399 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380487 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380566 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380646 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380723 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380802 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380802 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.380974 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381055 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381133 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381220 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381324 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381418 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381501 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381580 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381658 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381744 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381833 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.381927 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382009 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382096 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382183 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382264 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382344 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382431 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382523 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382605 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382690 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382770 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382848 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.382936 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383028 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383109 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383198 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383279 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383370 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383453 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383531 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383618 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383773 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.383899 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.384089 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.384212 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.384404 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.384545 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.384745 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.384873 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.385065 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.385193 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.385422 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.385558 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.385723 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.385849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.386025 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.386230 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.386357 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.386515 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.386640 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.386777 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387049 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387179 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387311 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387443 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387567 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387700 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387825 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.387949 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.388112 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.388241 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.388419 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.388556 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.388728 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.388885 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.389031 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.389169 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.389332 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.389434 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.389644 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.389732 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.390489 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.390583 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.390793 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.390890 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.391117 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.391212 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.391423 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.391531 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.391725 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.391814 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.392031 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.392124 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.392332 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.392419 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.392646 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.392733 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.392953 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.393047 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.393307 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.393466 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.393619 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.393765 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.393904 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.394041 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.394193 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.394342 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.394581 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.394726 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.394865 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.395010 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.395149 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.395296 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.395442 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.395582 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.395720 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.395869 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.396015 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.396161 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.396390 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.396559 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.396703 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.396841 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.396995 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.397207 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.397395 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.397542 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.397682 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.397821 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.397967 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.398106 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.398245 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.398394 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.398532 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.398678 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.398849 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.398993 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.399131 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.399280 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.399426 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.399564 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.399716 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.399864 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.400011 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.400184 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.400447 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.400591 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.400745 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.400895 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.401053 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.401193 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.401353 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.401501 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.401650 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.401790 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.401928 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.402076 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.402235 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.402383 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.402522 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.402660 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.402798 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.402943 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.403089 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.403235 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.403374 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.403512 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.403649 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.403793 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.403932 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.404089 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.404228 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.404399 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.404573 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.404717 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.404854 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.405006 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.405157 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.405379 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.405563 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.406224 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.406396 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.406604 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.406758 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.406907 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.407048 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.407204 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.407394 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.407537 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.407681 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.407820 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.407957 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.408095 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.408241 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.408380 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.408517 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.408665 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.408812 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.408958 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.409105 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.409261 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.409406 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.409571 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.409715 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.409887 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.410032 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.410206 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.410350 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.410577 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.410731 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.410879 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.411024 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.411162 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.411301 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.411439 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.411576 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.411722 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.411860 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.412006 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.412174 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.412333 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.412488 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.412639 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.412777 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.413035 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.413187 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.413413 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.413618 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.413782 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.414027 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.414170 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.414349 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.414663 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.414818 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.414968 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.415256 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.415402 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.415597 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.415819 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.415972 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.416217 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.416361 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.416523 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.416836 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.416983 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.417204 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.417515 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.417739 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.417882 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.418134 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.418287 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.418457 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.418612 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.418772 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.418918 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.419085 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.419244 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.419383 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.419554 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.419699 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.419873 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.420025 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.420172 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.420311 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.420623 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.420774 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.420913 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.421229 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.421451 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.421603 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.421869 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.422015 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.422164 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.422300 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.422478 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.422632 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.422778 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.422918 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.423089 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.423247 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.423417 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.423561 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.423736 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.423891 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.424036 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.424192 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.424377 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.424529 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.424689 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.424840 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.425003 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.425150 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.425342 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.425485 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.425659 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.425811 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.425951 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.426097 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.426268 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.426413 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.426577 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.426746 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.426914 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.427066 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.427206 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.427343 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.427509 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.427654 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.427805 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.428057 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.428213 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.428362 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.428501 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.428648 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.428802 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.428941 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.429080 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.429225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.429421 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.429568 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.429716 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.429863 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.430002 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.430140 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.430288 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.430426 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.430671 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.430883 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.431033 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.431174 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.431312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.431459 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.431598 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.431744 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.431891 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.432037 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.432188 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.432336 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.432476 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.432614 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.432752 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.432891 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.433029 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.433175 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.433349 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.433489 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.433635 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.433781 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.433987 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.434142 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.434282 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.434477 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.434631 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.434799 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.434953 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.435122 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.435439 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.435585 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.435772 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.435926 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.436087 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.436241 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.436391 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.436531 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.436762 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.436909 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.437059 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.437207 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.437401 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.437543 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.437688 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.437834 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.437980 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.438120 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.438277 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.438418 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.438556 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.438703 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.438865 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.439010 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.439157 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.439297 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.439475 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.439621 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.439783 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.439935 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.440083 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.440232 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.440371 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.440508 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.440656 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.440840 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.441073 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.441217 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.441393 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.441534 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.441673 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.441901 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.442051 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.442191 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.442343 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.442488 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.442628 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.442775 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.442915 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.443053 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.443192 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.443341 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.443481 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.443628 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.443769 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.443907 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.444046 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.444194 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.444341 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.444490 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.444630 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.444769 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.444907 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.445045 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.445192 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.445386 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.445486 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.445602 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.445731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.445931 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.446072 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.446246 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.446379 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.446552 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.446684 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.446862 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.447023 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.447172 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.447296 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.447481 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.447602 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.447788 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.447891 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.448104 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.448192 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.448419 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.448514 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.448732 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.448835 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.449043 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.449131 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.449377 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.449534 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.449685 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.449826 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.449985 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.450127 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.450265 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.450401 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.450548 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.450687 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.450846 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.450991 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.451210 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.451363 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.451510 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.451657 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.451797 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.451945 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.452083 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.452231 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.452947 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.453096 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.453280 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.453428 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.453577 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.453730 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.453870 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.454008 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.454146 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.454296 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.454434 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.454581 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.454728 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.454866 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.455004 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.455158 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.455307 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.455447 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.455594 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.455734 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.455873 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.456010 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.456167 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.456315 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.456454 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.456626 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.456774 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.456912 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.457063 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.457228 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.457404 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.457546 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.457685 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.457823 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.457973 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.458123 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.458262 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.458400 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.458545 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.458693 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.458833 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.458970 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.459183 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.459328 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.459467 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.459614 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.459754 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.459899 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.460049 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.460188 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.460327 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.460473 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.460613 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.460760 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.460900 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.461038 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.461175 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.461399 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.461543 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.461689 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.461829 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.461977 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.462136 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.462277 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.462423 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.462562 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.462701 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.462846 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.462995 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.463135 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.463272 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.463411 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.463549 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.463706 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.463854 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.463994 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.464131 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.464277 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.464416 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.464561 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.464709 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.464856 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.464996 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.465134 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.465289 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.465445 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.465595 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.465735 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.465873 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.466034 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.466187 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.466341 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.466488 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.466657 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.466818 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.466964 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.467109 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.467262 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.467414 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.467574 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.467726 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.467873 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.468096 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.468756 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.468904 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.469050 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.469203 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.469405 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.469552 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.469707 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.469851 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.469998 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.470157 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.470310 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.470534 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.470689 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.470841 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.470987 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.471132 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.471289 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.471444 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.471590 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.471733 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.471878 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.472023 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.472179 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.472337 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.472483 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.472634 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.472780 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.472931 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.473077 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.473230 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.473417 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.473563 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.473716 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.473868 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.474032 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.474180 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.474332 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.474487 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.474634 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.474779 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.474936 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.475083 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.475229 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.475409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.475557 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.475701 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.475855 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.476013 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.476165 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.476312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.476456 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.476600 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.476758 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.476904 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.477048 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.477193 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.477376 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.477546 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.477702 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.477849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.478004 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.478148 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.478292 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.478450 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.478596 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.478748 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.478900 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.479045 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.479190 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.479344 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.479490 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.479641 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.479788 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.479950 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.480096 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.480253 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.480400 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.480545 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.480690 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.480833 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.480986 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.481139 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.481316 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.481476 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.481623 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.481779 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.481933 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.482078 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.482223 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.482367 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.482519 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.482673 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.482828 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.482974 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.483127 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.483279 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.483425 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.483569 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.483786 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.483934 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.484079 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.484235 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.484381 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.484532 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.484687 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.484832 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.484977 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.485174 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.485397 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.485553 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.485707 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.485864 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.486016 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.486182 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.486337 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.486490 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.486637 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.486791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.486938 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.487090 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.487237 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.487393 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.487549 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.487713 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.487860 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.488004 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.488157 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.488303 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.488449 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.488608 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.488755 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.488908 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.489053 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.489197 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.489380 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.489527 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.489685 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.489830 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.489975 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.490130 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.490284 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.490436 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.490582 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.490788 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.490940 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.491174 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.491334 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.491480 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.491625 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.491793 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.492013 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.492161 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.492315 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.492461 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.492604 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.492762 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.492914 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.493075 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.493220 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.493429 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.493577 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.493734 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.493888 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.494047 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.494201 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.494347 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.494493 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.494638 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.494782 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.494935 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.495081 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.495227 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.495372 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.495524 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.495684 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.495838 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.495984 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.496137 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.496283 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.496428 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.496582 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.496728 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.496873 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.497018 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.497169 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.497351 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.497517 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.497684 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.497837 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.497982 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.498126 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.498272 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.498424 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.498578 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.498724 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.498875 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.499021 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.499166 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.499404 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.499633 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.499881 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.500117 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.500314 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.500530 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.500741 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.500937 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.501149 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.501644 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.501806 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.501926 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502024 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502118 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502209 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502292 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502372 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502462 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502545 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502625 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502704 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502783 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502870 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.502961 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.503126 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.503226 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.503456 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.503548 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.503766 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.503859 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.504075 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.504166 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.504382 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.504470 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.504683 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.504778 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.504984 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.505082 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.505310 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.505416 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.505619 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.505724 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.505920 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.506020 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.506219 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.506317 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.506518 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.506608 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.506840 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.506929 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.507142 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.507239 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.507462 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.507558 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.507769 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.507869 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.508070 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.508174 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.508371 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.508460 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.508670 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.508760 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.509007 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.509145 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.509333 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.509439 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.509664 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.509759 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.509973 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.510147 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.510304 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.510463 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.510610 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.510763 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.510919 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.511073 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.511219 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.511365 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.511529 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.511682 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.511838 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.511985 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.512130 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.512274 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.512426 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.512572 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.512732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.512882 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.513028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.513172 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.513352 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.513509 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.513666 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.513812 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.514098 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.514252 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.514423 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.514584 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.514739 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.515406 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.515560 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.515706 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.515851 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.516016 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.516164 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.516309 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.516454 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.516599 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.516779 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.517004 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.517163 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.517355 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.517515 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.517670 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.517826 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.517959 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.518048 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.518129 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.518275 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.518393 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.518598 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.518723 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.518926 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.519058 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.519240 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.519377 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.519552 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.519695 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.519867 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.520011 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.520181 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.520327 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.520534 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.520685 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.520847 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.521002 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.521150 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.521409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.521502 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.521733 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.521821 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.522054 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.522172 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.522380 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.522468 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.522676 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.522764 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.522986 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.523085 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.523296 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.523385 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.523605 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.523693 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.523911 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.524083 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.524221 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.524310 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.524532 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.524620 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.524846 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.525004 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.525176 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.525356 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.525516 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.525605 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.525829 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.525920 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.526141 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.526241 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.526452 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.526540 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.526773 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.526963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.527279 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.527366 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.527600 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.527704 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.527924 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.528012 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.528248 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.528336 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.528559 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.528657 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.528872 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.528968 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.529191 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.529297 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.529517 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.529617 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.529825 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.529914 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.530134 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.530219 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.530440 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.530586 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.531296 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.531393 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.531606 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.531695 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.531925 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.532032 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.532232 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.532320 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.532538 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.532625 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.532847 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.532936 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.533160 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.533395 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.533725 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.533848 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.534045 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.534137 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.534371 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.534461 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.534697 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.534796 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.535012 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.535101 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.535316 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.535405 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.535630 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.535727 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.535932 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.536022 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.536238 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.536338 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.536549 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.536651 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.536857 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.536946 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.537161 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.537276 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.537486 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.537607 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.537796 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.538103 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.538192 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.538407 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.538589 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.538725 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.538911 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.539028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.539255 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.539343 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.539641 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.539843 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.539933 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.540239 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.540322 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.540547 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.540648 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.540847 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.540936 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.541149 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.541238 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.541475 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.541587 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.541774 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.541864 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.542080 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.542169 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.542386 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.542513 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.542781 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.542888 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.542997 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.543091 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.543304 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.543395 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.543648 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.543735 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.543950 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.544037 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.544253 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.544351 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.544567 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.544673 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.544866 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.544961 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.545168 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.545282 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.545505 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.545596 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.545813 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.545901 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.546173 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.546277 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.546491 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.546590 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.546798 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.546894 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.547110 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.547212 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.547440 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.547529 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.547754 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.547970 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.548060 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.548301 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.548389 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.548616 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.548704 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.548944 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.549237 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.549374 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.549583 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.549684 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.549893 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.549983 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.550196 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.550284 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.550516 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.550606 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.550825 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.550925 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.551133 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.551221 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.551440 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.551534 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.551743 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.551832 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.552048 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.552136 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.552354 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.552451 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.552659 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.552748 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.552964 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.553059 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.553299 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.553402 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.553608 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.553696 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.553913 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.554009 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.554219 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.554389 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.554524 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.554614 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.554829 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.554918 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.555138 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.555234 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.555451 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.555539 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.555762 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.555850 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.556075 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.556164 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.556385 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.556501 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.556703 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.556811 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.557008 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.557105 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.557336 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.557430 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.557646 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.557735 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.557955 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.558045 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.558266 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.558355 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.558580 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.558675 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.558893 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.558982 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.559191 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.559278 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.559512 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.559845 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.559944 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.560164 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.560253 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.560471 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.560555 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.560803 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.561115 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.561202 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.561463 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.561552 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.561827 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.561918 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.562143 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.562232 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.562457 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.562543 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.562763 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.562852 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.563093 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.563188 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.563406 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.563493 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.563730 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.563820 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.564044 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.564133 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.564346 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.564444 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.564649 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.564738 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.564953 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.565041 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.565278 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.565387 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.565594 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.565683 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.565898 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.565994 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.566198 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.566296 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.566497 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.566586 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.566803 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.566910 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.567102 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.567199 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.567401 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.567489 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.567699 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.567787 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.567997 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.568088 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.568299 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.568387 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.568596 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.568684 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.568895 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.568985 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.569194 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.569305 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.569515 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.569615 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.569820 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.569908 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.570115 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.570201 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.570420 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.570506 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.570716 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.570804 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.571015 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.571104 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.571314 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.571411 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.571613 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.571702 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.571910 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.572007 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.572214 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.572310 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.572521 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.572618 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.572828 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.572917 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.573135 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.573237 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.573486 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.573574 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.573806 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.573895 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.574156 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.574265 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.574430 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.574527 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.574746 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.574834 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.575054 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.575142 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.575358 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.575446 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.575683 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.575771 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.575987 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.576075 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.576294 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.576384 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.576603 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.576691 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.576912 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.577012 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.577216 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.577867 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.578080 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.578182 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.578398 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.578494 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.578713 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.578810 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.579014 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.579111 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.579326 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.579414 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.579639 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.579733 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.579954 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.580055 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.580270 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.580358 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.580578 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.580666 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.580903 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.581001 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.581213 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.581325 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.581544 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.581645 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.581852 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.581942 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.582160 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.582250 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.582471 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.582560 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.582783 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.582876 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.583093 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.583188 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.583400 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.583488 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.583712 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.583802 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.584019 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.584106 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.584332 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.584437 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.584649 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.584739 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.584954 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.585048 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.585287 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.585392 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.585619 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.585714 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.585948 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.586043 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.586257 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.586364 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.586587 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.586682 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.586930 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.587016 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.587224 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.587321 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.587534 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.587622 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.587838 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.587926 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.588095 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:19:17.588219 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.588539 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.588857 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.589168 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:19:17.589438 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:19:17.742423 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Registered counter for database nova_api Sep 09 20:19:17.746500 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Registered counter for database nova_api Sep 09 20:19:17.768334 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:17.769993 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:17.774800 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:17.776498 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:17.831198 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.context [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a4293c1-c873-423b-9687-2d61c3d59ab1(cell1) {{(pid=105451) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 20:19:17.833729 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.context [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a4293c1-c873-423b-9687-2d61c3d59ab1(cell1) {{(pid=105450) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 20:19:17.835142 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:19:17.835613 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:19:17.837172 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:19:17.837738 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:19:17.837895 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:19:17.838216 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:19:17.838321 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:19:17.839785 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:19:17.840269 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:19:17.840502 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:19:17.840951 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:19:17.842229 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Registered counter for database nova_cell0 Sep 09 20:19:17.842948 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_concurrency.lockutils [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:19:17.845025 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Registered counter for database nova_cell0 Sep 09 20:19:17.846218 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Registered counter for database nova_cell1 Sep 09 20:19:17.849133 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Registered counter for database nova_cell1 Sep 09 20:19:17.853047 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:17.854507 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:17.856379 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:17.860564 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:17.861183 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:17.861910 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:17.863288 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:18.003140 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:18.006592 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO dbcounter [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Registered counter for database nova_cell0 Sep 09 20:19:18.011462 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO dbcounter [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Registered counter for database nova_cell0 Sep 09 20:19:18.013588 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_db.sqlalchemy.engines [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:18.018589 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writer thread running {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:18.021160 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:19:18.025781 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writer thread running {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:19:18.352741 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:19:18.359974 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:19:18.361105 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:19:18.368363 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:19:18.702361 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:19:18.708266 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: WARNING keystonemiddleware.auth_token [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:19:18.713524 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56360ed229c0 pid: 105451 (default app) Sep 09 20:19:18.715557 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:19:18.716717 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001695 Sep 09 20:19:18.717127 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Fri Sep 9 20:19:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:19:18.724551 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:19:18.730506 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: WARNING keystonemiddleware.auth_token [None req-86dc9082-fcbd-4875-b601-7903dc94571a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:19:18.736286 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56360ed229c0 pid: 105450 (default app) Sep 09 20:20:39.333718 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:39.334726 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 09 20:20:39.335110 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:20:39.347061 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:39.348373 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell0:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:39.349613 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell1:SELECT=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:39.351760 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:40.268907 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-85c9877c-fb3d-47a8-b2a6-8a13b8178e42 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:40.305646 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-85c9877c-fb3d-47a8-b2a6-8a13b8178e42 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.963620 Sep 09 20:20:40.306470 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Sep 9 20:20:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:20:42.967363 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:42.968360 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a080cf2b-68c8-435e-82de-bf327259a46c None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 09 20:20:42.968757 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:20:43.416127 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-052e5132-820b-4475-b256-80757fbf75e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "disk": 1, "vcpus": 1, "swap": 0, "ram": 256}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:43.462543 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-052e5132-820b-4475-b256-80757fbf75e2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487578 Sep 09 20:20:43.463276 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:20:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:20:43.684118 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-ab2470ea-1977-49d0-9c3a-9a269b42035a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:43.691111 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:43.692168 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell1:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:43.693101 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=3 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:43.693866 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:20:43.755500 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-ab2470ea-1977-49d0-9c3a-9a269b42035a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284164 Sep 09 20:20:43.756088 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Sep 9 20:20:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:20:46.404205 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-052e5132-820b-4475-b256-80757fbf75e2 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:46.405508 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-052e5132-820b-4475-b256-80757fbf75e2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Sep 09 20:20:46.406042 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:20:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:20:47.086915 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-9d0ad143-cfe0-468d-8976-7f194386727b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:47.125357 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-9d0ad143-cfe0-468d-8976-7f194386727b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712832 Sep 09 20:20:47.126420 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:20:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:20:47.139529 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-3f31c121-a0fb-4e88-b669-6fc1e65b1d85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:47.185517 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-3f31c121-a0fb-4e88-b669-6fc1e65b1d85 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049933 Sep 09 20:20:47.186392 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Sep 9 20:20:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:20:49.782684 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-9d0ad143-cfe0-468d-8976-7f194386727b admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:49.783731 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-9d0ad143-cfe0-468d-8976-7f194386727b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 09 20:20:49.784132 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:20:50.225361 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-207b7515-51f3-4c89-9198-421e35260208 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:50.244434 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-207b7515-51f3-4c89-9198-421e35260208 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453833 Sep 09 20:20:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:20:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:20:50.258111 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-15943886-fccc-4362-9a61-198e3f99434e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:50.286767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-15943886-fccc-4362-9a61-198e3f99434e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032392 Sep 09 20:20:50.287733 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Sep 9 20:20:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:20:52.956265 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-207b7515-51f3-4c89-9198-421e35260208 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:52.957189 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-207b7515-51f3-4c89-9198-421e35260208 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 09 20:20:52.957776 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:20:53.376165 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-4fca62d5-c8c4-4f5d-bf58-c0b15b47747a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:53.396629 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-4fca62d5-c8c4-4f5d-bf58-c0b15b47747a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432943 Sep 09 20:20:53.397175 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:20:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:20:53.409960 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-55472b4a-d1de-4f57-bded-9ca2725626e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:53.438289 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-55472b4a-d1de-4f57-bded-9ca2725626e8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032053 Sep 09 20:20:53.441506 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Sep 9 20:20:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:20:56.092063 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-4fca62d5-c8c4-4f5d-bf58-c0b15b47747a admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:56.093007 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-4fca62d5-c8c4-4f5d-bf58-c0b15b47747a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 09 20:20:56.093922 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:20:56.563931 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a2b9b3e8-c398-46cf-9b96-6f255fd36d56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:56.586700 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a2b9b3e8-c398-46cf-9b96-6f255fd36d56 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486376 Sep 09 20:20:56.587550 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:20:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:20:56.599696 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1c9cf9f7-a1da-432a-9ccf-f53b4a7973c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:20:56.631471 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-1c9cf9f7-a1da-432a-9ccf-f53b4a7973c8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035300 Sep 09 20:20:56.632321 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Fri Sep 9 20:20:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:20:59.779237 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a2b9b3e8-c398-46cf-9b96-6f255fd36d56 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:20:59.780284 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a2b9b3e8-c398-46cf-9b96-6f255fd36d56 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 09 20:20:59.780689 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:00.191812 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-8e7453c6-0795-475f-9658-a9c597d3153e admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:00.216514 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-8e7453c6-0795-475f-9658-a9c597d3153e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.429031 Sep 09 20:21:00.217040 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Sep 9 20:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:21:02.883266 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-a2b9b3e8-c398-46cf-9b96-6f255fd36d56 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:02.884376 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-a2b9b3e8-c398-46cf-9b96-6f255fd36d56 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Sep 09 20:21:02.884808 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:03.302294 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-d08de336-b84c-4641-883f-c31caaf63b0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:03.322871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-d08de336-b84c-4641-883f-c31caaf63b0c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.430942 Sep 09 20:21:03.323511 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:21:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:21:03.335931 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-2b004ef0-7589-4329-bc91-6a2cef0b2a12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:03.365056 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-2b004ef0-7589-4329-bc91-6a2cef0b2a12 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032959 Sep 09 20:21:03.365937 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Sep 9 20:21:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:21:06.029457 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-d08de336-b84c-4641-883f-c31caaf63b0c admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:06.030489 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-d08de336-b84c-4641-883f-c31caaf63b0c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Sep 09 20:21:06.030914 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:21:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:21:06.448794 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-33e68d38-f22e-492d-a2ce-d1165235494f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:06.469802 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-33e68d38-f22e-492d-a2ce-d1165235494f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.432632 Sep 09 20:21:06.470352 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:21:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:21:06.482355 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1b92cf3f-c94a-46b4-a04e-3e8b30aef754 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:06.509934 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-1b92cf3f-c94a-46b4-a04e-3e8b30aef754 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031172 Sep 09 20:21:06.510594 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Sep 9 20:21:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:21:09.111395 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-33e68d38-f22e-492d-a2ce-d1165235494f admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:09.112419 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-33e68d38-f22e-492d-a2ce-d1165235494f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 09 20:21:09.112999 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:09.522504 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-8c11e808-932a-4960-9d1d-440d20739892 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:09.555229 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-8c11e808-932a-4960-9d1d-440d20739892 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.436198 Sep 09 20:21:09.555784 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:21:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:21:09.567723 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-22acb445-baa3-4cdf-8490-1b74a0aed900 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:09.572384 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:21:09.596500 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-22acb445-baa3-4cdf-8490-1b74a0aed900 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032373 Sep 09 20:21:09.597075 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Sep 9 20:21:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:21:12.193585 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-8c11e808-932a-4960-9d1d-440d20739892 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:12.194581 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-8c11e808-932a-4960-9d1d-440d20739892 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 09 20:21:12.194969 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:12.607869 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-989e52bc-5123-4653-97bc-97b319a16a77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "name": "m1.large", "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:12.635103 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-989e52bc-5123-4653-97bc-97b319a16a77 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434064 Sep 09 20:21:12.636023 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:21:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:21:12.648932 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-2905442b-62a5-4ae7-8a2e-50eba4057ae9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:12.678180 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-2905442b-62a5-4ae7-8a2e-50eba4057ae9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032819 Sep 09 20:21:12.678960 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Sep 9 20:21:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:21:15.291556 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-989e52bc-5123-4653-97bc-97b319a16a77 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:15.293262 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-989e52bc-5123-4653-97bc-97b319a16a77 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002200 Sep 09 20:21:15.301316 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:21:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:15.737295 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a07d7d8d-0f41-406b-a23d-45ed89a0781f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:15.743538 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:21:15.759721 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a07d7d8d-0f41-406b-a23d-45ed89a0781f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459856 Sep 09 20:21:15.761617 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Fri Sep 9 20:21:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:21:15.773351 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-07dbf8c1-99ef-49c5-99a0-4f4e098f95fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:15.802004 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-07dbf8c1-99ef-49c5-99a0-4f4e098f95fd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032356 Sep 09 20:21:15.802593 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Fri Sep 9 20:21:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:21:37.686790 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a07d7d8d-0f41-406b-a23d-45ed89a0781f admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:37.687803 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a07d7d8d-0f41-406b-a23d-45ed89a0781f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 09 20:21:37.688206 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:21:37.699272 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:21:38.076885 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-86986bda-f27a-447d-93e4-12d87da462eb admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:38.094985 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-86986bda-f27a-447d-93e4-12d87da462eb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400692 Sep 09 20:21:38.095523 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Sep 9 20:21:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:21:39.400109 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-a07d7d8d-0f41-406b-a23d-45ed89a0781f admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:39.401143 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-a07d7d8d-0f41-406b-a23d-45ed89a0781f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 09 20:21:39.401571 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:39.930149 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-27d43c3f-4805-41d4-b6bb-090f4e601d59 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:39.936025 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-27d43c3f-4805-41d4-b6bb-090f4e601d59 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-27d43c3f-4805-41d4-b6bb-090f4e601d59 admin admin] Request method failure captured: Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Accept: application/json Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Connection: keep-alive Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Content-Length: 0 Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Host: 10.222.0.26 Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjG6BTxBkSPV-X6napaV9G02wOpBaLOUelTUntRTwwZYWenfHp-AVIgUVRmZGfg7jeH6Pi4s5XYtOIG_r9eY1LPfBglvqmYc15GgRKxxSS8axvY3qVlW-1DclkvZkxmI5RPX4m4q6rwsSe7UTmgvF9WG5jp5bl6UzcjePsTH0q6AaSruo Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Role: admin,member,reader Sep 09 20:21:39.939570 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Roles: admin,member,reader Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant: admin Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User: admin Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Id: b20f75fb724246318736ac6f2901b55a Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Name: admin Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: method: > Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: exception: Flavor 42 could not be found. Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: action_args: {'id': '42'} Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:21:39.941225 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:39.942732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:39.944246 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-27d43c3f-4805-41d4-b6bb-090f4e601d59 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:21:39.945608 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-27d43c3f-4805-41d4-b6bb-090f4e601d59 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.401970 Sep 09 20:21:39.945608 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Sep 9 20:21:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:21:39.950872 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-37212e7b-21cd-46da-810c-d4256a443faf admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:39.972982 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-37212e7b-21cd-46da-810c-d4256a443faf admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025962 Sep 09 20:21:39.973543 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Sep 9 20:21:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:21:39.984519 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c15f95c5-9aa9-421b-a5ec-b8346979d8c1 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:40.006630 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c15f95c5-9aa9-421b-a5ec-b8346979d8c1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027001 Sep 09 20:21:40.007146 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Sep 9 20:21:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:21:40.016238 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-280c78b8-2c5e-44b4-9b12-ce59189a7a82 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:40.021688 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-280c78b8-2c5e-44b4-9b12-ce59189a7a82 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-280c78b8-2c5e-44b4-9b12-ce59189a7a82 admin admin] Request method failure captured: Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Accept: application/json Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Connection: keep-alive Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Content-Length: 0 Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Host: 10.222.0.26 Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjG6BTxBkSPV-X6napaV9G02wOpBaLOUelTUntRTwwZYWenfHp-AVIgUVRmZGfg7jeH6Pi4s5XYtOIG_r9eY1LPfBglvqmYc15GgRKxxSS8axvY3qVlW-1DclkvZkxmI5RPX4m4q6rwsSe7UTmgvF9WG5jp5bl6UzcjePsTH0q6AaSruo Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Role: admin,member,reader Sep 09 20:21:40.024874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Roles: admin,member,reader Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant: admin Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User: admin Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Id: b20f75fb724246318736ac6f2901b55a Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Name: admin Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: method: > Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: exception: Flavor 42 could not be found. Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: action_args: {'id': '42'} Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:21:40.026409 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:40.027455 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:40.028767 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-280c78b8-2c5e-44b4-9b12-ce59189a7a82 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:21:40.030057 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-280c78b8-2c5e-44b4-9b12-ce59189a7a82 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013536 Sep 09 20:21:40.030057 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Sep 9 20:21:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 20:21:41.232160 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-c15f95c5-9aa9-421b-a5ec-b8346979d8c1 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:41.233197 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-c15f95c5-9aa9-421b-a5ec-b8346979d8c1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 09 20:21:41.233622 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:41.756597 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1601b7fd-9d24-47cf-ab81-387920776794 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:41.761707 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-1601b7fd-9d24-47cf-ab81-387920776794 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1601b7fd-9d24-47cf-ab81-387920776794 admin admin] Request method failure captured: Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Accept: application/json Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Connection: keep-alive Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Content-Length: 0 Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Host: 10.222.0.26 Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjG6BVfch88rwWUI6Gd3DJAQs5K8q7hKqr4gtNGA5eXBLGotu8rG3TwQmbA7WfzaroFcXaxPAXjzE8aSIZ22WWpzdAuiWINEvZB7d3iodgF_8Onr3oeshpTSRUdLTMHlp_sn42zl195iiPK7E3EGrBU-DicgmTh6pi9IFAtppWtDY75p4 Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Role: admin,member,reader Sep 09 20:21:41.763208 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Roles: admin,member,reader Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant: admin Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User: admin Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Id: b20f75fb724246318736ac6f2901b55a Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Name: admin Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: method: > Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: exception: Flavor 84 could not be found. Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: action_args: {'id': '84'} Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:21:41.764791 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:41.765849 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.767195 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1601b7fd-9d24-47cf-ab81-387920776794 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:21:41.768462 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-1601b7fd-9d24-47cf-ab81-387920776794 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392333 Sep 09 20:21:41.768462 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Sep 9 20:21:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:21:41.774399 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-01ebd3d3-39bb-459c-b425-9f236d674a0f admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:41.789610 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-01ebd3d3-39bb-459c-b425-9f236d674a0f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018764 Sep 09 20:21:41.790127 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Sep 9 20:21:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:21:41.800001 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-83a3c8de-d7ce-4b33-94b5-15b6926b3429 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:41.814985 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-83a3c8de-d7ce-4b33-94b5-15b6926b3429 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018502 Sep 09 20:21:41.815510 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Sep 9 20:21:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:21:41.824682 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-097331a1-addc-4dcf-bb7e-7113935e0ea7 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:41.829560 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-097331a1-addc-4dcf-bb7e-7113935e0ea7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-097331a1-addc-4dcf-bb7e-7113935e0ea7 admin admin] Request method failure captured: Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Accept: application/json Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Connection: keep-alive Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Content-Length: 0 Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Host: 10.222.0.26 Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjG6BVfch88rwWUI6Gd3DJAQs5K8q7hKqr4gtNGA5eXBLGotu8rG3TwQmbA7WfzaroFcXaxPAXjzE8aSIZ22WWpzdAuiWINEvZB7d3iodgF_8Onr3oeshpTSRUdLTMHlp_sn42zl195iiPK7E3EGrBU-DicgmTh6pi9IFAtppWtDY75p4 Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Role: admin,member,reader Sep 09 20:21:41.831090 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Roles: admin,member,reader Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant: admin Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User: admin Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Id: b20f75fb724246318736ac6f2901b55a Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Name: admin Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: method: > Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: exception: Flavor 84 could not be found. Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: action_args: {'id': '84'} Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:21:41.832511 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:41.833474 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:41.834963 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-097331a1-addc-4dcf-bb7e-7113935e0ea7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:21:41.836268 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-097331a1-addc-4dcf-bb7e-7113935e0ea7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011272 Sep 09 20:21:41.836268 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Sep 9 20:21:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 20:21:43.048684 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-83a3c8de-d7ce-4b33-94b5-15b6926b3429 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:43.049716 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-83a3c8de-d7ce-4b33-94b5-15b6926b3429 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 09 20:21:43.050103 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:43.565384 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-2abb53ba-bc4f-43bf-b3ae-68879fc24bff admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:43.571099 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.wsgi [None req-2abb53ba-bc4f-43bf-b3ae-68879fc24bff admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-2abb53ba-bc4f-43bf-b3ae-68879fc24bff admin admin] Request method failure captured: Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Accept: application/json Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Accept-Encoding: gzip, deflate Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Connection: keep-alive Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Content-Length: 0 Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Host: 10.222.0.26 Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Openstack-Api-Version: compute 2.92 Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Openstack-System-Scope: None Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: User-Agent: python-novaclient Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Auth-Token: gAAAAABjG6BWq0b8CRQ5VqDyVyLufcXUOexLdsGL464kmH0CROL6RD3RZWR_0-gT3Gf1E66TW61oVz1Z8Y4_ULJ5IbZTf501zi6ftV4On8ajGaFNDjGw70AUU47rvV3pGuateaKum02ah9APkQ610UJfuihDmwi56-JQd0b3y9S3QfVxMUNT4NE Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Domain-Id: None Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Domain-Name: None Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Identity-Status: Confirmed Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Is-Admin-Project: True Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Domain-Id: default Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Domain-Name: Default Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Project-Name: admin Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Role: admin,member,reader Sep 09 20:21:43.572600 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Roles: admin,member,reader Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant: admin Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-Tenant-Name: admin Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User: admin Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Domain-Id: default Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Domain-Name: Default Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Id: b20f75fb724246318736ac6f2901b55a Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: X-User-Name: admin Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: method: > Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: exception: Flavor 451 could not be found. Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: action_args: {'id': '451'} Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:21:43.574731 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:43.575732 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-2abb53ba-bc4f-43bf-b3ae-68879fc24bff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:21:43.578640 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-2abb53ba-bc4f-43bf-b3ae-68879fc24bff admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390740 Sep 09 20:21:43.578640 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Sep 9 20:21:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:21:43.584123 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-246e2f67-6083-4845-a101-4e77172b8103 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:43.599140 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-246e2f67-6083-4845-a101-4e77172b8103 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018594 Sep 09 20:21:43.599648 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Sep 9 20:21:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:21:43.608627 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:43.623117 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017950 Sep 09 20:21:43.623636 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Sep 9 20:21:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:21:43.632560 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-44eaca40-f09f-47d3-bc25-a6410aaf6e19 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:43.637835 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.wsgi [None req-44eaca40-f09f-47d3-bc25-a6410aaf6e19 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-44eaca40-f09f-47d3-bc25-a6410aaf6e19 admin admin] Request method failure captured: Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Accept: application/json Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Accept-Encoding: gzip, deflate Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Connection: keep-alive Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Content-Length: 0 Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Host: 10.222.0.26 Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Openstack-Api-Version: compute 2.92 Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Openstack-System-Scope: None Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: User-Agent: python-novaclient Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Auth-Token: gAAAAABjG6BWq0b8CRQ5VqDyVyLufcXUOexLdsGL464kmH0CROL6RD3RZWR_0-gT3Gf1E66TW61oVz1Z8Y4_ULJ5IbZTf501zi6ftV4On8ajGaFNDjGw70AUU47rvV3pGuateaKum02ah9APkQ610UJfuihDmwi56-JQd0b3y9S3QfVxMUNT4NE Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Domain-Id: None Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Domain-Name: None Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Identity-Status: Confirmed Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Is-Admin-Project: True Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Domain-Id: default Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Domain-Name: Default Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Project-Name: admin Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Role: admin,member,reader Sep 09 20:21:43.639312 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Roles: admin,member,reader Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e8a4d19e4885495c84cf29b80391fd52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant: admin Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant-Id: e8a4d19e4885495c84cf29b80391fd52 Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-Tenant-Name: admin Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User: admin Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Domain-Id: default Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Domain-Name: Default Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Id: b20f75fb724246318736ac6f2901b55a Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: X-User-Name: admin Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: method: > Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: exception: Flavor 451 could not be found. Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: action_args: {'id': '451'} Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:21:43.640871 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:43.641997 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: ERROR nova.api.openstack.wsgi Sep 09 20:21:43.643176 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-44eaca40-f09f-47d3-bc25-a6410aaf6e19 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:21:43.644199 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-44eaca40-f09f-47d3-bc25-a6410aaf6e19 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011459 Sep 09 20:21:43.644199 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Sep 9 20:21:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:21:44.852433 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:44.853581 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 09 20:21:44.853977 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:45.373620 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-4d9f4951-2e29-47ad-978e-b3eff7bfa724 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:45.393509 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-4d9f4951-2e29-47ad-978e-b3eff7bfa724 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401453 Sep 09 20:21:45.394049 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Sep 9 20:21:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:21:46.606782 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:46.607787 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 09 20:21:46.608180 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:47.122493 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-783f82e3-77c1-42fe-bd15-06c676fb884f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:47.140974 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-783f82e3-77c1-42fe-bd15-06c676fb884f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.396181 Sep 09 20:21:47.141548 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Sep 9 20:21:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:21:48.349165 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:48.350187 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 09 20:21:48.350576 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:48.868643 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-078775e1-0876-4452-a98c-4cd1755939c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:48.887725 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-078775e1-0876-4452-a98c-4cd1755939c7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.400492 Sep 09 20:21:48.888264 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Sep 9 20:21:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:21:50.089481 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:50.090503 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Sep 09 20:21:50.090888 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:50.612514 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-359ff6bb-803f-49b4-baac-632f53e95164 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:21:50.631480 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-359ff6bb-803f-49b4-baac-632f53e95164 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405938 Sep 09 20:21:50.632021 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Sep 9 20:21:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:21:51.862675 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:51.863678 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 09 20:21:51.864081 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:21:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:21:52.380614 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1a54fa01-bfbf-43bd-88d3-e3650c3f8965 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:21:52.400602 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-1a54fa01-bfbf-43bd-88d3-e3650c3f8965 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398850 Sep 09 20:21:52.401133 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Fri Sep 9 20:21:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:22:49.385022 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:22:49.386136 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-940c8fcf-7c5f-4b94-b6ee-f44848406f64 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 09 20:22:49.386541 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Fri Sep 9 20:22:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:22:49.396833 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:22:49.771898 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-cfffcd03-cf2a-4b93-95f7-ce1221fc0cfe admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:22:49.791961 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-cfffcd03-cf2a-4b93-95f7-ce1221fc0cfe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399608 Sep 09 20:22:49.792488 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Fri Sep 9 20:22:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:22:49.813974 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=14 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:22:49.817789 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-3335c6ba-b4b4-47c9-ba92-f1919f3e3942 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:22:49.825735 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-3335c6ba-b4b4-47c9-ba92-f1919f3e3942 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013209 Sep 09 20:22:49.826253 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Fri Sep 9 20:22:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:22:49.837613 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-43efb233-39c7-4657-b58e-ea1d822f4d37 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:22:49.844611 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-43efb233-39c7-4657-b58e-ea1d822f4d37 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010540 Sep 09 20:22:49.845127 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Fri Sep 9 20:22:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:22:49.856758 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:22:49.863871 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010615 Sep 09 20:22:49.864388 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Fri Sep 9 20:22:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:22:49.876260 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-d2232a5e-0644-49a5-a571-6c6244eb487b admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:22:49.883892 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-d2232a5e-0644-49a5-a571-6c6244eb487b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011347 Sep 09 20:22:49.884393 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Fri Sep 9 20:22:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:26:01.758718 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:01.759723 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 09 20:26:01.760150 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:26:01.906929 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=6 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:26:02.064603 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:02.070531 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:02.071116 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:02.071554 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:02.072271 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:02.072824 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:02.073269 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:02.105182 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-99d0eb06-24cf-47da-baa1-50a4db2f8678 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199467 Sep 09 20:26:02.105781 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Sep 9 20:26:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:26:03.185532 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:03.186528 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 09 20:26:03.186919 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:26:03.379108 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:03.383178 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:03.383651 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:03.384110 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:03.384874 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:03.385348 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:03.385768 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:03.404873 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-99372d86-be2b-4484-900e-bb4ebb622779 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077696 Sep 09 20:26:03.405477 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Sep 9 20:26:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:26:14.901831 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:14.902834 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 09 20:26:14.903230 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:26:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:26:15.047405 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell0:SELECT=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:26:15.048114 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_cell1:SELECT=4 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:26:15.048771 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG dbcounter [-] [105451] Writing DB stats nova_api:SELECT=8 {{(pid=105451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:26:15.095825 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:15.099721 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:15.100193 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:15.100621 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:15.101371 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:15.101822 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:15.102240 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:15.127589 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-d8f6c748-127f-4168-9e50-b8ca3ec649f9 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084656 Sep 09 20:26:15.128136 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Sep 9 20:26:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:26:16.206218 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG nova.api.openstack.wsgi [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] Calling method '>' {{(pid=105450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:16.207209 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: INFO nova.api.openstack.requestlog [None req-201fe598-cd11-41a0-a38f-1d8531f413d4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Sep 09 20:26:16.207598 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: [pid: 105450|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Sep 9 20:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:26:16.396174 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG nova.api.openstack.wsgi [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] Calling method '>' {{(pid=105451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:26:16.399568 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:16.400040 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:16.400463 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:16.401161 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:26:16.401626 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:26:16.402036 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: DEBUG oslo_concurrency.lockutils [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:26:16.423481 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: INFO nova.api.openstack.requestlog [None req-1a21a01a-d268-4b2a-9f2a-c41c293879cb admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078606 Sep 09 20:26:16.424016 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: [pid: 105451|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Sep 9 20:26:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:27:16.239415 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: Fri Sep 9 20:27:16 2022 - graceful shutdown triggered... Sep 09 20:27:16.239140 dv-cinder-849325-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 20:27:16.240323 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: Gracefully killing worker 1 (pid: 105450)... Sep 09 20:27:16.240811 dv-cinder-849325-4-iscsi devstack@n-api.service[105451]: Gracefully killing worker 2 (pid: 105451)... Sep 09 20:27:16.365384 dv-cinder-849325-4-iscsi devstack@n-api.service[105450]: DEBUG dbcounter [-] [105450] Writing DB stats nova_api:SELECT=4 {{(pid=105450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:27:17.240156 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: worker 1 buried after 1 seconds Sep 09 20:27:17.240709 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: worker 2 buried after 1 seconds Sep 09 20:27:17.240709 dv-cinder-849325-4-iscsi devstack@n-api.service[105449]: goodbye to uWSGI. Sep 09 20:27:17.241730 dv-cinder-849325-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 20:27:17.242530 dv-cinder-849325-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 20:27:17.245385 dv-cinder-849325-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 20:27:17.254901 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 20:27:17 2022] *** Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: nodename: dv-cinder-849325-4-iscsi Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: machine: x86_64 Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: clock source: unix Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: pcre jit disabled Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: detected number of CPU cores: 4 Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: current working directory: / Sep 09 20:27:17.257000 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: detected binary path: /usr/bin/uwsgi-core Sep 09 20:27:17.257772 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: your processes number limit is 47680 Sep 09 20:27:17.257772 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: your memory page size is 4096 bytes Sep 09 20:27:17.257772 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: detected max file descriptor number: 2048 Sep 09 20:27:17.257772 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: lock engine: pthread robust mutexes Sep 09 20:27:17.257772 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: thunder lock: enabled Sep 09 20:27:17.257772 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 20:27:17.257772 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 20:27:17.300236 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: Python main interpreter initialized at 0x555b8895e9c0 Sep 09 20:27:17.300236 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: python threads support enabled Sep 09 20:27:17.300236 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: your server socket listen backlog is limited to 100 connections Sep 09 20:27:17.300236 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: your mercy for graceful operations on workers is 90 seconds Sep 09 20:27:17.300676 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 20:27:17.300676 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: *** Operational MODE: preforking *** Sep 09 20:27:17.300987 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: *** uWSGI is running in multiple interpreter mode *** Sep 09 20:27:17.300987 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: spawned uWSGI master process (pid: 120658) Sep 09 20:27:17.301189 dv-cinder-849325-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 20:27:17.302680 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: spawned uWSGI worker 1 (pid: 120679, cores: 1) Sep 09 20:27:17.302680 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: spawned uWSGI worker 2 (pid: 120680, cores: 1) Sep 09 20:27:17.302680 dv-cinder-849325-4-iscsi devstack@n-api.service[120658]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 20:27:17.962357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 20:27:17.969996 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 20:27:19.143775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:27:19.143775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: from cryptography.utils import int_from_bytes Sep 09 20:27:19.144467 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:27:19.144467 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: from cryptography.utils import int_from_bytes Sep 09 20:27:19.145279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:27:19.145279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: from cryptography.utils import int_from_bytes Sep 09 20:27:19.145718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:27:19.145718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: from cryptography.utils import int_from_bytes Sep 09 20:27:21.550349 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:27:21.550947 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:27:21.551224 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:27:21.551525 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:27:21.551777 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:27:21.552166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.552492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.552814 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.553135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.553506 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.553810 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.554136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.554456 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.554786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.555048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.555362 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.555852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-4-iscsi {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.556180 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.556492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.556805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.557128 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.557463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.557788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.558096 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.558603 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.559971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.559971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.559971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.560393 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.560628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.560936 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.561263 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.561592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.561926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.562234 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.562633 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-4-iscsi {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.562950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.563276 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.563586 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.564007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.564924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.565189 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.565546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.565869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.566170 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.566500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.566819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.567137 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.567452 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.567756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.568067 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.568392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.568697 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.569007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.569334 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.569590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.569808 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:27:21.570243 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.570329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:27:21.570412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.570591 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.570722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:27:21.570918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.571195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:27:21.571305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.571393 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:27:21.571489 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.571577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.571662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.571869 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.571994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.572175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.572290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.572476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.572577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.572802 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.572905 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.573112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.573230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.573460 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.573558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.573740 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.573906 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.574075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.574231 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.574386 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.574542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.574698 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.574857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.575019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.575175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849325-4-iscsi {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.575334 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.575527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.575706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.575864 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.576070 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.576256 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.576407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.576563 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.576718 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.576880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.577028 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.577174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.577412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.577589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.577739 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.577739 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.578030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.578219 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.578372 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.578518 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.578671 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.578849 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.579006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.579169 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.579326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.579482 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.579640 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.579852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.580031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.580192 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.580341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.580507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.580739 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.580891 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.581038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.581192 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.581372 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.581521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.581689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849325-4-iscsi {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.581847 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.581995 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.585366 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.585543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.585719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.585880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.586078 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.586078 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.586378 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.586545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.586694 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.586849 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.587006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.587162 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.587317 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.587492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.587641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.587788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.587934 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.588081 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.588235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.588409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.588565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.588715 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.588869 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.589017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.589165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.589383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.589547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.589694 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.589849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.589997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.590154 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.590311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.590459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.590605 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.590759 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.590923 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.591082 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.591242 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.591409 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.591409 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.591714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.591869 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.592037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.592037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.592369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.592369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.592703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.592863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.593041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.593191 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.593390 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.593549 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.593706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.593863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.594012 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.594167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.594325 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.594481 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.594638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.596242 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.596415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.596569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.596786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.596950 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.597099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.597277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.597442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.597591 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.597753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.597910 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.598073 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.598222 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.598370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.598527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.598685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.598865 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.601103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.601332 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.601677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.601838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.601988 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.602136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.602284 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.602440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.602603 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.602762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.602918 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.603090 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.603248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.603407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.603566 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.603723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.603881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.604030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.604185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.604346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.604495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.604649 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.604809 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.604958 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.605124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.605327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.605528 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.605686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.605849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.606015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.606248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.606248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.606558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.609152 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.609408 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.609581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.609772 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.609935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.610096 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.610253 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.610413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.610563 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.610720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.610881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.611040 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.611723 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.611874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.612031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.612195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.612357 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.612505 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.612661 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.612817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.612973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.613134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.613327 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.613483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.613631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.613778 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.613936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.614099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.614248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.614248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.614549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.614696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.614858 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.615006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.615185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.615335 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.615482 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.616417 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.616590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.616771 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.617217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.617429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.617580 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.617740 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.617888 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.618042 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.618931 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.619109 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.619269 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.619427 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.619576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.619732 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.619908 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.620071 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.620239 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.620396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.620545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.620699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.621020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.621193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.621449 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.621614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.621770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.621927 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.622089 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.622246 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.622401 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.622560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.622715 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.622870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.623027 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.623190 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.623352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.623501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.623501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.623781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.623935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.624097 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.624253 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.624409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.624567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.624722 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.624878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.625035 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.625192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.625361 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.625527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.625693 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.625996 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.626163 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.626321 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.626523 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.626718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.626893 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.627050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.627214 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.627362 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.627509 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.627656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:27:21.627803 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.627965 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.628122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.628290 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.628799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.628982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.629238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.629425 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.629575 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.629731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.629881 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.630030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.630177 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.630336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.630503 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.633320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.633511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.633679 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.633851 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.634015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.634177 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.634328 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.634476 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.634623 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.634780 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.634929 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.635086 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.635236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.635392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.635547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.635710 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.635866 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.636225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.636377 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.636575 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.636738 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.636897 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.637045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.637200 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.637403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.637562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.637725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.637874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.637874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.638304 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.638463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.639012 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.639185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.639470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.639621 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.639770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.639917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.640074 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.640233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.640381 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.640629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.640821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.640983 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.641131 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.641312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.641476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.641675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.641823 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.641977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.642134 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.642282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.642464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.642612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.642774 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.642923 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.643090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.643246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.643521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.643671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.643829 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.643977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.644141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.644377 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.644567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.644717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.644864 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.645010 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.645171 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.645354 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.645503 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.645650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.645810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.645966 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.646277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.646444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.646640 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.646795 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.646943 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.647101 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.647257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.647431 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.647586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.647733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.647881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.648133 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.648290 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.648437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.648583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.649103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.649471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.649650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.649808 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.649957 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.650118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.650273 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.650431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.650587 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.650735 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.650881 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.651036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.651198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.651427 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.651600 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.651758 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.651914 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.652064 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.652231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.652388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.652552 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.652713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.652869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.653029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.653177 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.653527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.653692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.653848 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.654004 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.654164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.654313 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.654487 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.654644 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.654799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.654953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.661335 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.661471 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.661584 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.661682 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.661783 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.661870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.661955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662428 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662522 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662618 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662811 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662906 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.662992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663077 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663176 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663263 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663452 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663547 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663831 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.663932 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664118 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664218 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664406 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664670 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.664947 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665044 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665406 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665591 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665760 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.665951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666209 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666726 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.666906 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667003 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667089 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667181 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667443 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667533 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667659 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667749 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.667929 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668224 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.668941 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669023 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669183 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669371 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669606 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.669960 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670034 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670263 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670425 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670498 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670569 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670860 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.670933 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671004 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671081 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671161 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671241 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671622 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671694 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671694 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.671997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672070 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672153 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672232 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672311 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672390 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672624 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672933 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.672933 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.673075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.673154 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.673228 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.677408 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678214 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678323 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678548 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678548 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.678992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679450 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679601 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679746 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.679974 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680760 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680841 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.680921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.681001 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.681075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.681154 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.682754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.682927 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.683092 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.683247 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.683420 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.683739 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.683902 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.684090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.684586 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.684752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.684928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.685097 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.685281 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.685455 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.685658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.685827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.685990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.686156 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.686506 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.686673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.686835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.686999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.687163 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.687340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.687510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.687711 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.687879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.688035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.688199 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.688364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.688528 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.688691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.688846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.689009 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.689716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.689898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.690065 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.690222 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.690376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.690538 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.690707 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.690865 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.691020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.691182 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.691340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.691502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.691667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.691831 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.692005 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.692169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.692351 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.692581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.692751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.692916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.693070 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.693225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.693412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.693585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.693987 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.694165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.694340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.694839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.695012 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.695179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.695335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.695489 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.695651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.695806 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.696067 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.696288 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.696465 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.696798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.696970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.696970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.697333 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.697496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.697650 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.697845 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.698004 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.698159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.698329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.698485 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.698639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.698792 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.698953 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.699108 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.699289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.699445 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.699445 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.699740 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.699909 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.700066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.700234 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.700392 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.700546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.700699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.700861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.701027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.701190 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.701395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.701553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.701720 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.701882 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.702038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.702191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.702346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.702507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.702676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.702839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.703002 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.703165 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.703320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.703500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.703656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.703978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.703978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.704285 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.704448 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.705523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.705523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.705843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.706008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.706164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.706334 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.706515 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.706680 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.707022 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.707183 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.707345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.707501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.707666 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.707862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.708023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.708186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.708340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.708541 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.708698 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.708865 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.709130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.709322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.709484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.709648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.709805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.709959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.710119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.710275 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.710437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.710602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.710758 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.710920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.711093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.711257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.711412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.711581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.711744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.711900 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.712069 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.712069 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.712374 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.712374 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.712669 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.712832 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.712986 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.713160 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.713402 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.713561 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.713722 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.713934 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.714229 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.714401 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.714572 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.715026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.715203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.715368 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.715553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.715797 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.715970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.716136 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.716300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.716462 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.716625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.716861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.717046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.717407 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.717571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.717735 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.717937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.718115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.718294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.718460 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.718624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.718780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.718950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.719240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.719409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.719565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.719719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.719872 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.720033 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.720199 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.720363 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.720567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.720724 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.720878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.721042 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.721205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.721398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.721563 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.721718 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.721873 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.722041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.722205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.722361 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.722516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.722688 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.722851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.723020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.723176 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.723332 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.723486 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.723639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.723801 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.723971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.724829 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.725390 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.725586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.725769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.725997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.726159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.726313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.726477 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.726632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.726786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.726941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.727094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.727248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.727613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.727780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.727956 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.728165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.728320 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.728531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.728531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.728874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.729043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.729227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.729488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.729667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.729833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.729989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.730155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.730317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.730504 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.730799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.730975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.731132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.731307 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.731471 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.731626 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.731790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.731955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.731955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.732265 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.732431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.732602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.732760 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.732915 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.733076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.733258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.733424 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.733592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.733756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.733919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.734083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.734239 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.734505 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.734687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.734846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.735001 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.735001 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.735618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.735774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.735940 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.736481 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.736654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.736810 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.737005 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.737176 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.737784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.737784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.738176 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.738346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.738513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.738679 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.738835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.738989 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.739144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.739308 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.739483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.739726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.739825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.739909 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.739997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740180 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740425 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740623 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740733 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.740924 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741010 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741207 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741428 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741524 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.741856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742325 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742674 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742760 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742860 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.742956 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743042 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743399 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743494 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743674 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.743952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744120 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744205 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744385 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744498 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744669 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.744938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.745026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.745111 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.745195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.745648 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.745770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.745861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.745947 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746047 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746149 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746407 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746514 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746601 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746775 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.746959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747051 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747319 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747406 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747500 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747709 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747816 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.747919 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748432 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748803 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748897 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.748985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749172 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749303 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749482 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749566 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749651 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749761 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749838 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.749932 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750019 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750111 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750390 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750482 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750580 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.750957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751043 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751224 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751311 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751566 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.751641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752416 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752850 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.752951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753045 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753642 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753895 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.753990 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754077 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754162 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754256 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754436 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754714 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754798 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.754981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755068 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755153 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755245 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755331 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755443 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755758 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.755946 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756513 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.756943 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757128 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757316 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757598 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757694 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757866 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.757954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758029 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758533 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758732 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.758913 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759000 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759092 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759188 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759276 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759360 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759452 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759538 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759630 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759727 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759815 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.759896 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760024 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760109 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760303 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760665 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760802 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.760981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761208 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761314 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761393 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761476 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761709 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.761942 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762016 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762242 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762314 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762385 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762457 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762528 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.762938 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763331 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763506 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763656 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763737 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763811 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.763883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764171 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764251 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764330 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764720 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.764949 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.765028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.765028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.765171 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.765292 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.765384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.765459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.765539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.766415 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.766520 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.766596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.766684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.766774 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.766881 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.766968 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767042 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767345 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767446 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767637 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767734 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.767978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768350 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768439 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768523 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768668 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768850 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.768938 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769117 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769210 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769763 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.769935 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770011 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770083 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770330 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770895 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.770975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771199 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771273 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771273 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771273 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771476 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771633 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771791 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771872 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.771966 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772157 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772400 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772487 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772587 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.772948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.773467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.773556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.773641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.773746 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.773835 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.773920 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774375 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774468 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774648 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774744 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.774925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775018 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775112 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775292 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775292 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.775976 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776319 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776565 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776761 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.776951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777110 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777110 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777286 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777377 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777479 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777652 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777736 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777830 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.777917 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778012 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778207 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778284 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778450 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778538 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778797 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.778969 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779051 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779351 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779433 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779645 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.779973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780065 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780152 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780236 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780423 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780600 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780694 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.780950 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781053 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781226 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781600 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781785 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781881 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.781968 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782161 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782255 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782434 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782702 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.782879 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.783480 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.783576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.783676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.783763 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.783849 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.783936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.784130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.784226 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.784435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.784538 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.784748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.784851 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.785053 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.785164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.785395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.785506 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.785704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.785807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.786019 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.786168 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.786331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.786449 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.786726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.786830 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.787030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.787145 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.787336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.787488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.787648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.787754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.787977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.788073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.788297 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.788437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.788607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.788735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.788930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.789037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.789234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.789427 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.789562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.789663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.789870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.789966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.790178 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.790271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.790497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.790589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.790806 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.790915 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.791110 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.791224 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.791414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.791525 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.791725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.791820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.792029 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.792270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.792365 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.792608 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.792703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.792925 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.793017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.793235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.793356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.793564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.793668 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.793870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.793973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.794175 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.794277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.794479 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.794574 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.794784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.794894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.795087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.795195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.795396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.795489 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.795700 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.795801 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.796010 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.796217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.796388 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.796538 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.796807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.796966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797323 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797323 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797506 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.797912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.798125 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.798228 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.798434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.798553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.798794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.798919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.799105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.799218 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.799422 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.799526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.799758 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.799853 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.800074 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.800169 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.800386 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.800479 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.800699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.800801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.801014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.801116 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.801355 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.801471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.801667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.801768 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.801978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.802080 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.802286 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.802394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.802602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.802704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.802928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.803024 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.803241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.803346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.803546 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.803641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.803870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.803963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.804190 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.804293 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.804513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.804607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.804828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.804922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.805139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.805272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.805497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.805593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.805809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.805905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.806121 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.806224 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.806429 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.806523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.806870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.806995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.807087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.807181 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.807352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.807449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.807662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.807766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.807973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.808076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.808290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.808385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.808591 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.808766 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.808894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.808998 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.809204 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.809356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.809543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.809663 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.809853 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.809965 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.810154 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.810249 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.810454 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.810558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.810763 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.810865 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.811064 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.811166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.811366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.811463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.811668 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.811772 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.811971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.812066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.812278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.812373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.812578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.812673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:27:21.812878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.813178 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.813502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.813802 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.814101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.814920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.815222 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.815526 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.815827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.816127 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.816434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.816766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.817097 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.817479 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.817811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.818120 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.818439 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.818750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.819073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.819395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.819705 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.820014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.820346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.820655 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.820966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.821294 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.821609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.821915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.822223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.822548 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.822871 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.823176 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.823499 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.823815 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.824132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.824814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.824814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.825062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.825390 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.825747 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.826009 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.826325 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.826636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.826946 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.827250 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.827559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.827874 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.828186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.828511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.828836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.829145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.829495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.829859 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.830721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.831031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.831374 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.831703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.832014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.832325 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.832628 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:27:21.832868 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:27:21.875163 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO dbcounter [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Registered counter for database nova_api Sep 09 20:27:21.894982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO dbcounter [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Registered counter for database nova_api Sep 09 20:27:21.896297 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:21.903030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:21.914675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:21.921297 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:21.960013 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.context [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a4293c1-c873-423b-9687-2d61c3d59ab1(cell1) {{(pid=120680) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 20:27:21.964131 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:27:21.964606 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:27:21.966214 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:27:21.966957 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:27:21.967405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:27:21.969421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:27:21.971409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO dbcounter [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Registered counter for database nova_cell0 Sep 09 20:27:21.975484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO dbcounter [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Registered counter for database nova_cell1 Sep 09 20:27:21.982167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.context [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a4293c1-c873-423b-9687-2d61c3d59ab1(cell1) {{(pid=120679) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 20:27:21.982911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:21.983906 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:27:21.984387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:27:21.984550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:21.985998 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:27:21.987303 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:27:21.987742 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:27:21.989756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:27:21.991402 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:21.991765 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO dbcounter [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Registered counter for database nova_cell0 Sep 09 20:27:21.992964 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:21.996021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO dbcounter [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Registered counter for database nova_cell1 Sep 09 20:27:22.003778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:22.006164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:22.011785 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:22.014052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:22.140201 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO dbcounter [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Registered counter for database nova_cell0 Sep 09 20:27:22.147525 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_db.sqlalchemy.engines [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:22.152268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writer thread running {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:22.163827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO dbcounter [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Registered counter for database nova_cell0 Sep 09 20:27:22.170477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_db.sqlalchemy.engines [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:27:22.174939 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writer thread running {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:27:22.469705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:27:22.477566 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:27:22.498649 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:27:22.505981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:27:22.836356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:27:22.843880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: WARNING keystonemiddleware.auth_token [None req-53020881-d903-4bf8-8cfa-9dad66b01899 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:27:22.849782 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555b8895e9c0 pid: 120680 (default app) Sep 09 20:27:22.859070 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:27:22.866030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: WARNING keystonemiddleware.auth_token [None req-1967cb57-2f84-40bd-9cc4-24efdd4af738 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:27:22.871712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555b8895e9c0 pid: 120679 (default app) Sep 09 20:27:59.775634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:27:59.776904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:27:59.777989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:27:59.780063 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:01.264049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ca01ec8-5251-4e65-a798-da60a82d0d23 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Action: 'create', calling method: .version_select at 0x7f4835b2f430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-74431436"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:02.254925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:02.255946 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:02.258459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:02.260445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:02.630260 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ca01ec8-5251-4e65-a798-da60a82d0d23 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 2.872141 Sep 09 20:28:02.631296 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Fri Sep 9 20:27:59 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 2876 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 20:28:02.649019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-648b0a04-aa5d-4a5a-8c67-08dacb63bd34 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a00310>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:02.835636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17bf5356-a9d4-4ab6-a728-6d0a35516a44 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f4835b770d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:02.859770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-648b0a04-aa5d-4a5a-8c67-08dacb63bd34 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d" status: 200 len: 343 microversion: 2.1 time: 0.217010 Sep 09 20:28:02.860403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 2/2] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:02 2022] GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:03.793115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17bf5356-a9d4-4ab6-a728-6d0a35516a44 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f0202ffe-6f4a-4202-b692-1185c84a08bb" status: 200 len: 349 microversion: 2.1 time: 1.544908 Sep 09 20:28:03.796125 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:02 2022] GET /compute/v2.1/os-volumes/f0202ffe-6f4a-4202-b692-1185c84a08bb => generated 349 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:28:03.877015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f31ac60a-c182-4ad1-9051-9839cf686a42 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a009d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:04.012500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f31ac60a-c182-4ad1-9051-9839cf686a42 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d" status: 200 len: 344 microversion: 2.1 time: 0.139845 Sep 09 20:28:04.013917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:03 2022] GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:04.030341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b378055-5337-43e7-a452-6781194f9b81 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Action: 'create', calling method: .version_select at 0x7f4835a421f0>, body: {"snapshot": {"volume_id": "b9533d73-d693-43cf-9297-2793b670759d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-206508115"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:04.608050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b378055-5337-43e7-a452-6781194f9b81 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.582048 Sep 09 20:28:04.618114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 2/5] 10.222.0.26 () {60 vars in 1162 bytes} [Fri Sep 9 20:28:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:04.627865 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-144808ef-898b-4081-9baf-bc4433780b85 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f48359990d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:04.952531 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-144808ef-898b-4081-9baf-bc4433780b85 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 200 len: 286 microversion: 2.1 time: 0.333665 Sep 09 20:28:04.954723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 4/6] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Sep 9 20:28:04 2022] GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 286 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:28:04.966224 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9651c350-c173-4c4c-a916-7155eae531c1 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a120d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:05.058225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9651c350-c173-4c4c-a916-7155eae531c1 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.095081 Sep 09 20:28:05.065588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1140 bytes} [Fri Sep 9 20:28:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:05.070645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-facf3f24-652a-4c42-9cea-cbe8145ffbab tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a00ca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:05.148894 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-facf3f24-652a-4c42-9cea-cbe8145ffbab tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 200 len: 286 microversion: 2.1 time: 0.082203 Sep 09 20:28:05.149752 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Sep 9 20:28:05 2022] GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:05.625335 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-63fdc9bc-8a0d-429b-a650-76fc8644c5f9 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f48359954c0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:05.724314 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-63fdc9bc-8a0d-429b-a650-76fc8644c5f9 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/36821bdc-10b4-491e-9029-fa4903d6817b" status: 200 len: 351 microversion: 2.1 time: 0.105619 Sep 09 20:28:05.725774 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 4/9] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:05 2022] GET /compute/v2.1/os-volumes/36821bdc-10b4-491e-9029-fa4903d6817b => generated 351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:06.161737 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76cfd002-e82c-4b35-bb12-a35823a41db9 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a005e0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:06.223027 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76cfd002-e82c-4b35-bb12-a35823a41db9 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 200 len: 286 microversion: 2.1 time: 0.064928 Sep 09 20:28:06.224144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 6/10] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Sep 9 20:28:06 2022] GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:07.239426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09f51836-bd60-487a-8ea0-fb8b98334233 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a12820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:07.290918 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09f51836-bd60-487a-8ea0-fb8b98334233 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 200 len: 286 microversion: 2.1 time: 0.057477 Sep 09 20:28:07.292102 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 5/11] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Sep 9 20:28:07 2022] GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:08.304939 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06ab894a-5bda-4a5e-9af2-98c5a2f6d263 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f48359991f0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:08.376667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06ab894a-5bda-4a5e-9af2-98c5a2f6d263 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 200 len: 287 microversion: 2.1 time: 0.075331 Sep 09 20:28:08.383041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Sep 9 20:28:08 2022] GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:08.395016 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-406ae6c2-a620-4d09-8c47-3f7c52dc5ca6 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a42280>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:08.574174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-406ae6c2-a620-4d09-8c47-3f7c52dc5ca6 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 202 len: 0 microversion: 2.1 time: 0.182838 Sep 09 20:28:08.574703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 6/13] 10.222.0.26 () {58 vars in 1254 bytes} [Fri Sep 9 20:28:08 2022] DELETE /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:28:08.584416 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8a59ef8-b915-45a5-93d1-68347cc053f8 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a003a0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:08.647129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8a59ef8-b915-45a5-93d1-68347cc053f8 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 200 len: 286 microversion: 2.1 time: 0.067044 Sep 09 20:28:08.647762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 8/14] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Sep 9 20:28:08 2022] GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:09.101155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4561973f-4afe-4905-9716-adbd62a0d8b0 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f483635c3a0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:09.208037 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4561973f-4afe-4905-9716-adbd62a0d8b0 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/c55df22b-aa29-497a-82bd-cf14ba21fb94" status: 200 len: 351 microversion: 2.1 time: 0.110559 Sep 09 20:28:09.217205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 7/15] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:09 2022] GET /compute/v2.1/os-volumes/c55df22b-aa29-497a-82bd-cf14ba21fb94 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:09.222596 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6e52f80b-3a21-43bd-8296-159b1cf67861 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f4835a00c10>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:09.414651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6e52f80b-3a21-43bd-8296-159b1cf67861 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.195748 Sep 09 20:28:09.415598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1134 bytes} [Fri Sep 9 20:28:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:09.430912 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba0db8a0-6061-47af-8c4e-2f431b4b5781 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f4835a42160>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:09.644809 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba0db8a0-6061-47af-8c4e-2f431b4b5781 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.217770 Sep 09 20:28:09.645537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1149 bytes} [Fri Sep 9 20:28:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:09.667742 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d5412ab-8891-464e-be36-1e2bd2307b5f tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f4835995820>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:09.675405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39fe1441-a532-450f-a576-9e8e81ef8c9f tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835999ca0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:09.775484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-39fe1441-a532-450f-a576-9e8e81ef8c9f tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] HTTP exception thrown: Snapshot 59d698de-045c-4d42-b7f9-324e2216af6f could not be found. Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39fe1441-a532-450f-a576-9e8e81ef8c9f tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Request method failure captured: Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f HTTP/1.1 Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HPXiOnGK0zotQqvpeB2542961O8LpcqQlXG4EPSQc02gV1jJVD7YtabtPink_na4RBq0PwimrKzeF-v8QkZrx0jDNU_4zn8VhSbQvzIeUo2OErJplZTbQMh28HxQtxszu9ssXqGxFldKw_PN9orwRYHtbboyAd9DCN8CKkT3GgYdM Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:28:09.780049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bae95c402e44346959aca56968761aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bae95c402e44346959aca56968761aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: eb174dab2ed04d34857dcd27a17480f9 Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Snapshot 59d698de-045c-4d42-b7f9-324e2216af6f could not be found. Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '59d698de-045c-4d42-b7f9-324e2216af6f'} Sep 09 20:28:09.781498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 59d698de-045c-4d42-b7f9-324e2216af6f could not be found. (HTTP 404) (Request-ID: req-c41f68d6-7722-4fdf-b397-1ac4e3d29999) Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:09.782146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:28:09.783000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 59d698de-045c-4d42-b7f9-324e2216af6f could not be found. Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 20:28:09.783887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 59d698de-045c-4d42-b7f9-324e2216af6f could not be found. Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 59d698de-045c-4d42-b7f9-324e2216af6f could not be found. Sep 09 20:28:09.784871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:09.787263 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-39fe1441-a532-450f-a576-9e8e81ef8c9f tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Returning 404 to user: Snapshot 59d698de-045c-4d42-b7f9-324e2216af6f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:28:09.788759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-39fe1441-a532-450f-a576-9e8e81ef8c9f tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f" status: 404 len: 111 microversion: 2.1 time: 0.131999 Sep 09 20:28:09.790106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 10/18] 10.222.0.26 () {58 vars in 1251 bytes} [Fri Sep 9 20:28:09 2022] GET /compute/v2.1/os-snapshots/59d698de-045c-4d42-b7f9-324e2216af6f => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:28:09.804465 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2bf06a88-c25a-462c-b6a6-26e69954ed55 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835a00670>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:09.962609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d5412ab-8891-464e-be36-1e2bd2307b5f tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.304233 Sep 09 20:28:09.964407 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 9/19] 10.222.0.26 () {58 vars in 1134 bytes} [Fri Sep 9 20:28:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:09.980348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1cb0508e-0f14-4e75-82d9-c22313dc8992 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f48359a25e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:09.987459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2bf06a88-c25a-462c-b6a6-26e69954ed55 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d" status: 202 len: 0 microversion: 2.1 time: 0.192247 Sep 09 20:28:09.988206 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:28:09 2022] DELETE /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:28:10.004549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eed63392-4716-48f8-afe2-f6010ef4b10e tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f483597f280>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:10.135560 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eed63392-4716-48f8-afe2-f6010ef4b10e tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d" status: 200 len: 343 microversion: 2.1 time: 0.142437 Sep 09 20:28:10.137823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 12/21] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:09 2022] GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d => generated 343 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:10.208367 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1cb0508e-0f14-4e75-82d9-c22313dc8992 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.233692 Sep 09 20:28:10.211694 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 10/22] 10.222.0.26 () {58 vars in 1167 bytes} [Fri Sep 9 20:28:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:10.230852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9dae42b4-8cb2-4c61-b4f0-4bdcea07dd13 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f4835a00700>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:10.477593 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9dae42b4-8cb2-4c61-b4f0-4bdcea07dd13 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.255205 Sep 09 20:28:10.479682 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 13/23] 10.222.0.26 () {58 vars in 1170 bytes} [Fri Sep 9 20:28:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:10.496730 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0bac0937-ccfc-4a9a-8409-920311095a22 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f4835b2e700>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:10.746556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0bac0937-ccfc-4a9a-8409-920311095a22 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.256557 Sep 09 20:28:10.747746 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1155 bytes} [Fri Sep 9 20:28:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:10.763472 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6f543cd-b893-4128-a8f0-e33d16d8cc8c tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f483597fb80>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:11.013301 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6f543cd-b893-4128-a8f0-e33d16d8cc8c tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.255702 Sep 09 20:28:11.013869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1188 bytes} [Fri Sep 9 20:28:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:11.031473 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8fd20892-7b36-4b99-8ca3-3208c7d8edc6 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] Calling method '.version_select at 0x7f48359a2ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:11.220043 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8fd20892-7b36-4b99-8ca3-3208c7d8edc6 tempest-VolumesTestJSON-887848206 tempest-VolumesTestJSON-887848206-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.194435 Sep 09 20:28:11.221576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 15/26] 10.222.0.26 () {58 vars in 1155 bytes} [Fri Sep 9 20:28:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:11.228538 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-003b3731-2b5d-480a-9132-88e493926ba3 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f483597fd30>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:11.320890 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-003b3731-2b5d-480a-9132-88e493926ba3 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] HTTP exception thrown: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-003b3731-2b5d-480a-9132-88e493926ba3 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Request method failure captured: Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d HTTP/1.1 Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HPXiOnGK0zotQqvpeB2542961O8LpcqQlXG4EPSQc02gV1jJVD7YtabtPink_na4RBq0PwimrKzeF-v8QkZrx0jDNU_4zn8VhSbQvzIeUo2OErJplZTbQMh28HxQtxszu9ssXqGxFldKw_PN9orwRYHtbboyAd9DCN8CKkT3GgYdM Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:28:11.324007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bae95c402e44346959aca56968761aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bae95c402e44346959aca56968761aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: eb174dab2ed04d34857dcd27a17480f9 Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'b9533d73-d693-43cf-9297-2793b670759d'} Sep 09 20:28:11.325106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. (HTTP 404) (Request-ID: req-8171963a-ec86-41f3-b684-ed42b32cae7a) Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.325804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:28:11.326714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 20:28:11.328289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-003b3731-2b5d-480a-9132-88e493926ba3 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Returning 404 to user: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-003b3731-2b5d-480a-9132-88e493926ba3 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d" status: 404 len: 109 microversion: 2.1 time: 0.102716 Sep 09 20:28:11.330911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 16/27] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:11 2022] GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:28:11.349521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0d420c1-c987-42b2-a485-589fd5ab0586 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f4835999ee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:11.422470 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-d0d420c1-c987-42b2-a485-589fd5ab0586 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] HTTP exception thrown: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0d420c1-c987-42b2-a485-589fd5ab0586 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Request method failure captured: Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d HTTP/1.1 Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HPXiOnGK0zotQqvpeB2542961O8LpcqQlXG4EPSQc02gV1jJVD7YtabtPink_na4RBq0PwimrKzeF-v8QkZrx0jDNU_4zn8VhSbQvzIeUo2OErJplZTbQMh28HxQtxszu9ssXqGxFldKw_PN9orwRYHtbboyAd9DCN8CKkT3GgYdM Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:28:11.425706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bae95c402e44346959aca56968761aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bae95c402e44346959aca56968761aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: eb174dab2ed04d34857dcd27a17480f9 Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'b9533d73-d693-43cf-9297-2793b670759d'} Sep 09 20:28:11.426796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. (HTTP 404) (Request-ID: req-55ea2215-5fb4-4d30-95bd-92394b915612) Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.427437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 20:28:11.428373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 20:28:11.429345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.430335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.432819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0d420c1-c987-42b2-a485-589fd5ab0586 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Returning 404 to user: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:28:11.434324 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d0d420c1-c987-42b2-a485-589fd5ab0586 tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d" status: 404 len: 109 microversion: 2.1 time: 0.090318 Sep 09 20:28:11.435414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 17/28] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:28:11 2022] DELETE /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:28:11.454616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5af0e246-288d-4e21-b854-9bbafb842f3e tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Calling method '.version_select at 0x7f483597fe50>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:11.566863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-5af0e246-288d-4e21-b854-9bbafb842f3e tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] HTTP exception thrown: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5af0e246-288d-4e21-b854-9bbafb842f3e tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Request method failure captured: Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d HTTP/1.1 Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HPXiOnGK0zotQqvpeB2542961O8LpcqQlXG4EPSQc02gV1jJVD7YtabtPink_na4RBq0PwimrKzeF-v8QkZrx0jDNU_4zn8VhSbQvzIeUo2OErJplZTbQMh28HxQtxszu9ssXqGxFldKw_PN9orwRYHtbboyAd9DCN8CKkT3GgYdM Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:28:11.569864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3bae95c402e44346959aca56968761aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3bae95c402e44346959aca56968761aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3bae95c402e44346959aca56968761aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 3bae95c402e44346959aca56968761aa Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-846755818 Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: eb174dab2ed04d34857dcd27a17480f9 Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-846755818-project Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'b9533d73-d693-43cf-9297-2793b670759d'} Sep 09 20:28:11.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. (HTTP 404) (Request-ID: req-8ebcc0bb-1385-4a5f-97d3-2940c1aa6c47) Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.571641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:28:11.572556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 20:28:11.574549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5af0e246-288d-4e21-b854-9bbafb842f3e tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] Returning 404 to user: Volume b9533d73-d693-43cf-9297-2793b670759d could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5af0e246-288d-4e21-b854-9bbafb842f3e tempest-VolumesSnapshotsTestJSON-846755818 tempest-VolumesSnapshotsTestJSON-846755818-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d" status: 404 len: 109 microversion: 2.1 time: 0.123420 Sep 09 20:28:11.576582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 18/29] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:28:11 2022] GET /compute/v2.1/os-volumes/b9533d73-d693-43cf-9297-2793b670759d => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:28:11.799141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bab92af1-eb1f-4329-9fb6-ce7a90ebf2b1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'create', calling method: .version_select at 0x7f4835995700>, body: {"keypair": {"name": "tempest-keypair-1909536023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsc2BcCKuHpTrmb0cfqBSAeW/Ai535seL1J5rYJo8QlUcUmKvUirlJRKmc1LJsdHsYMfMo5/JFO3pioB0VqfjDCq3WQReG+1Ts90pSNJ3HjOs0nny8BhifCEl1GZOMMLQ=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:11.948700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-bab92af1-eb1f-4329-9fb6-ce7a90ebf2b1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for project b310c05b03394f11b63f0a28f13d67b6. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:11.975675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-bab92af1-eb1f-4329-9fb6-ce7a90ebf2b1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for user 95bc48b6541c4388b45435036a1c4525 and project b310c05b03394f11b63f0a28f13d67b6. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:12.133634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bab92af1-eb1f-4329-9fb6-ce7a90ebf2b1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.289393 Sep 09 20:28:12.136994 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 12/30] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:28:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:28:13.487799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1793860457", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "networks": [{"uuid": "f1af1ec7-d9d8-4274-81f9-992fb1351ac3"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:13.779561 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] validate_networks() for [('f1af1ec7-d9d8-4274-81f9-992fb1351ac3', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:28:15.872962 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:28:15.873594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:28:15.874577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:28:15.875122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:28:15.875644 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:28:15.902389 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:15.903157 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:15.903673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:15.904515 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:15.905959 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:15.907283 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:16.011032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Getting quotas for project 95899c2c318f459bb09bad337d79c1a2. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:16.027581 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Getting quotas for user fc41cb3dbe3845d794107f068c70db3f and project 95899c2c318f459bb09bad337d79c1a2. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:16.060650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:28:16.068985 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:28:16.237004 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3ae2952b-7dd9-4c8f-9f10-83dc1db5258a tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.205016 Sep 09 20:28:16.237359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 19/31] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:28:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 20:28:16.249707 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f32115ea-167c-48e0-9170-758b297c62c5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:16.250476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f32115ea-167c-48e0-9170-758b297c62c5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:16.575883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f32115ea-167c-48e0-9170-758b297c62c5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:16.623963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f32115ea-167c-48e0-9170-758b297c62c5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1215 microversion: 2.1 time: 0.372813 Sep 09 20:28:16.628164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 13/32] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:16 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1215 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:17.650566 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8e34f25c-ed63-4b30-85d8-2b33848143f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:17.651182 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8e34f25c-ed63-4b30-85d8-2b33848143f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:17.919928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8e34f25c-ed63-4b30-85d8-2b33848143f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:17.948817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8e34f25c-ed63-4b30-85d8-2b33848143f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1215 microversion: 2.1 time: 0.302293 Sep 09 20:28:17.962624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 20/33] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:17 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:18.149751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1414544366", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f13a2180-b7d4-4447-b571-f0f2b37395e2"}], "security_groups": [{"name": "tempest-securitygroup--74392672"}], "key_name": "tempest-keypair-1909536023", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:18.452748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] validate_networks() for [('f13a2180-b7d4-4447-b571-f0f2b37395e2', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:28:18.615520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-21bb45ea-e17f-4341-ad32-5aaabd227dca tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'create', calling method: .version_select at 0x7f4835940ca0>, body: {"keypair": {"name": "tempest-keypair-1742328126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAKfoMO8E8geWIT/1t9Np9zqiUOKENGmzTHrGz/3UoWw+Y5XQV7ArRNGCcqv4NhkLef5c5pE3C2LNVqi34e3GK9eypma72H4hSbn17v9G3Ejd/P/JEw9FXfSgor/WnJcg=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:18.675174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-21bb45ea-e17f-4341-ad32-5aaabd227dca tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for project 8c1c909559e44322a07f7e4a463424a5. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:18.685466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-21bb45ea-e17f-4341-ad32-5aaabd227dca tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for user db1f365ebf794941b3999adb37c48100 and project 8c1c909559e44322a07f7e4a463424a5. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:18.755829 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-21bb45ea-e17f-4341-ad32-5aaabd227dca tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.671674 Sep 09 20:28:18.761415 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 14/34] 10.222.0.26 () {62 vars in 1200 bytes} [Fri Sep 9 20:28:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 678 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 20:28:18.987620 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:18.988662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:19.002373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:19.002887 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:19.003311 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:19.004044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:19.004502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:19.004931 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:19.487807 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:19.519190 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40bdb5a9-6ad2-4ab9-9267-792b5205d9f8 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1267 microversion: 2.1 time: 0.533836 Sep 09 20:28:19.520963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 15/35] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:18 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1267 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:19.655268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:28:19.655925 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:28:19.656768 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:28:19.657538 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:28:19.658203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:28:19.681055 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:19.682604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:19.683051 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:19.688197 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:19.689088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:19.691115 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:19.746809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for project b310c05b03394f11b63f0a28f13d67b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:19.757408 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for user 95bc48b6541c4388b45435036a1c4525 and project b310c05b03394f11b63f0a28f13d67b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:19.791338 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:28:19.794164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:28:19.967182 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b78369f-961c-429c-bd43-2492c4094ee4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.821323 Sep 09 20:28:19.970046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 21/36] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:28:18 2022] POST /compute/v2.1/servers => generated 400 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 20:28:19.989838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbb53c1e-3e20-44cd-9bc8-3551828e25fd tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:19.990796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbb53c1e-3e20-44cd-9bc8-3551828e25fd tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:20.174523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1179825568", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:20.298524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cbb53c1e-3e20-44cd-9bc8-3551828e25fd tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:20.321799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbb53c1e-3e20-44cd-9bc8-3551828e25fd tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1238 microversion: 2.1 time: 0.338960 Sep 09 20:28:20.325625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 22/37] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:19 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1238 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:20.438568 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] validate_networks() for [('b188b4ef-6195-4514-85bf-2356d78cce90', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:28:20.551220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:20.552005 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:20.564096 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:20.564786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:20.568386 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:20.569404 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:20.570040 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:20.570491 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:21.179413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:21.213969 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-570dfaa6-9592-43d9-bf7b-70da64cf9aa7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1273 microversion: 2.1 time: 0.666658 Sep 09 20:28:21.219221 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 23/38] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:20 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1273 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:21.352459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-072ba247-e5cb-4651-a21b-50c6f8dd6532 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:21.353416 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-072ba247-e5cb-4651-a21b-50c6f8dd6532 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:21.625423 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-072ba247-e5cb-4651-a21b-50c6f8dd6532 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:21.634478 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-072ba247-e5cb-4651-a21b-50c6f8dd6532 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1238 microversion: 2.1 time: 0.286940 Sep 09 20:28:21.649271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 24/39] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:21 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1238 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:22.242566 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:22.243968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:22.269348 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:22.272252 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:22.275020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:22.282171 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:22.285164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:22.287725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:24.334293 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:24.347997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ffb11faa-d01e-4d4f-9d15-f824c80a6672 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 2.109943 Sep 09 20:28:24.373354 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 25/40] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:22 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:24.390537 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:24.391495 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:24.403049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:24.404899 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:24.407820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:24.415576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:24.422641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:24.423470 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:24.647434 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:24.656455 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-25fc95ff-a5f9-4532-9e22-06ba0b69ce00 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1296 microversion: 2.1 time: 0.281475 Sep 09 20:28:24.663063 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 26/41] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:24 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1296 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:24.831340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:28:24.832504 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:28:24.833216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:28:24.833875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:28:24.834446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:28:24.856611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:24.857941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:24.859093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:24.862867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:24.864095 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:24.866220 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:24.920118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for project f07defd609684351b4b7d0d110212a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:24.941205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for user a95746e7a84541199b43138b1a348386 and project f07defd609684351b4b7d0d110212a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:24.987960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:28:24.991204 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:28:25.162251 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5af68f29-e8ab-4a5a-b769-2812b7a82aba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.639888 Sep 09 20:28:25.163167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 16/42] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:28:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 5641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:28:25.175939 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbbf2d8e-d636-4c3a-9901-2090c3f93843 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:25.176857 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbbf2d8e-d636-4c3a-9901-2090c3f93843 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:25.405864 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:25.407069 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:25.430362 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:25.431188 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:25.432387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:25.434464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:25.434943 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:25.439854 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbbf2d8e-d636-4c3a-9901-2090c3f93843 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:25.449847 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbbf2d8e-d636-4c3a-9901-2090c3f93843 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1222 microversion: 2.1 time: 0.277860 Sep 09 20:28:25.450539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 27/43] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:25 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:25.465910 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:25.691633 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:25.692911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:25.707714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:25.711985 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:25.717967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:25.719216 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:25.721290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:25.726529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:26.245302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:26.261258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a59534e-4074-4c63-9dac-1d3b004495ec tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1296 microversion: 2.1 time: 0.572329 Sep 09 20:28:26.263508 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 28/44] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:25 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1296 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:26.284018 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1599669553", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:26.352088 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:26.360572 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e364328-3ca7-4893-988e-f4f22476b6f7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.962633 Sep 09 20:28:26.361168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 17/45] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:25 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:26.395048 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1978902806", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e922e249-8412-4a6f-a000-86403046577e"}], "security_groups": [{"name": "tempest-securitygroup--1882327398"}], "key_name": "tempest-keypair-1742328126", "user_data": "}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:26.460522 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] validate_networks() for [('b188b4ef-6195-4514-85bf-2356d78cce90', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:28:27.204778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] validate_networks() for [('e922e249-8412-4a6f-a000-86403046577e', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:28:29.550590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:28:29.551189 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:28:29.551784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:28:29.552502 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:28:29.554066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:28:29.578926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:29.583839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:29.585909 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:29.586975 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:29.588276 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:29.588968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:29.621975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:28:29.628053 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:28:29.631916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:28:29.632518 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:28:29.632940 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:28:29.638038 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for project f07defd609684351b4b7d0d110212a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:29.654517 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for user a95746e7a84541199b43138b1a348386 and project f07defd609684351b4b7d0d110212a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:29.673203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:29.673203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:29.673203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:29.673203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:29.673568 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:29.673568 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:29.692779 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:28:29.701282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:28:29.773842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for project 8c1c909559e44322a07f7e4a463424a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:29.787153 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for user db1f365ebf794941b3999adb37c48100 and project 8c1c909559e44322a07f7e4a463424a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:29.825560 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-34e9add9-68fd-428f-bd18-b0ff7b9995c5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.560145 Sep 09 20:28:29.828649 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 29/46] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:28:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:28:29.835970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:28:29.843282 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:28:29.856759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:29.857577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:29.883684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:29.885376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:29.887127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:29.890651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:29.891735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:29.892370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:30.050535 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5e2b4032-30ce-4897-a2a6-28f1df4227e2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.669772 Sep 09 20:28:30.051217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 18/47] 10.222.0.26 () {62 vars in 1188 bytes} [Fri Sep 9 20:28:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 3689 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 20:28:30.082125 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:30.085677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:30.101530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:30.102978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:30.105131 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:30.107808 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:30.108508 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:30.110918 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:30.859791 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:30.882889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-14c6c4d4-6d60-449f-b248-ecb44322f431 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 1.045132 Sep 09 20:28:30.884808 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 30/48] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:29 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:30.908412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-61843e88-77fc-45ae-b1f4-2dcf36c2102b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:30.915711 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:30.918913 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-61843e88-77fc-45ae-b1f4-2dcf36c2102b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:30.929020 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a98b0ab-7c9f-4110-93db-783be69ca2c3 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.869225 Sep 09 20:28:30.931902 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 19/49] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:30 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:30.943398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1dbedf9-6e9a-4d9d-acdc-e149d586b8ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:30.945629 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a1dbedf9-6e9a-4d9d-acdc-e149d586b8ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:31.097068 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-61843e88-77fc-45ae-b1f4-2dcf36c2102b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:31.116445 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-61843e88-77fc-45ae-b1f4-2dcf36c2102b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1222 microversion: 2.1 time: 0.220637 Sep 09 20:28:31.123387 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 31/50] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:30 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:31.330413 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1dbedf9-6e9a-4d9d-acdc-e149d586b8ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:31.342648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1dbedf9-6e9a-4d9d-acdc-e149d586b8ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:31.350533 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1dbedf9-6e9a-4d9d-acdc-e149d586b8ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:31.361128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1dbedf9-6e9a-4d9d-acdc-e149d586b8ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1282 microversion: 2.20 time: 0.425944 Sep 09 20:28:31.366703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 20/51] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:30 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1282 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:31.683273 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b59a7d42-67f3-43f1-9349-27083e65c0d2 req-fee63fc8-921b-4693-a952-2e641f690ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3294b2ee-c133-4483-a732-1b10f1130e44", "tag": "92ac06aa-3b8a-4813-af77-d204e8112bb0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:31.731937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b59a7d42-67f3-43f1-9349-27083e65c0d2 req-fee63fc8-921b-4693-a952-2e641f690ab3 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:31.734106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b59a7d42-67f3-43f1-9349-27083e65c0d2 req-fee63fc8-921b-4693-a952-2e641f690ab3 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:31.737983 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b59a7d42-67f3-43f1-9349-27083e65c0d2 req-fee63fc8-921b-4693-a952-2e641f690ab3 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:31.818981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b59a7d42-67f3-43f1-9349-27083e65c0d2 req-fee63fc8-921b-4693-a952-2e641f690ab3 service nova] Creating event network-changed:92ac06aa-3b8a-4813-af77-d204e8112bb0 for instance 3294b2ee-c133-4483-a732-1b10f1130e44 on hv-cinder-84932 Sep 09 20:28:31.821792 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-940364b7-a47a-411e-a10a-23b44a3b7927 req-5474ae4a-277e-4929-9bea-205b90381abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0ef033-9a7a-4b4d-8c77-2e52b202adec", "tag": "b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:31.826144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b59a7d42-67f3-43f1-9349-27083e65c0d2 req-fee63fc8-921b-4693-a952-2e641f690ab3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 20:28:31.833510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b59a7d42-67f3-43f1-9349-27083e65c0d2 req-fee63fc8-921b-4693-a952-2e641f690ab3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 20:28:31.836141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:31.837540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:31.841853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:31.843056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:31.843685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:31.844400 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:31.846015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-940364b7-a47a-411e-a10a-23b44a3b7927 req-5474ae4a-277e-4929-9bea-205b90381abf service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:31.846488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-940364b7-a47a-411e-a10a-23b44a3b7927 req-5474ae4a-277e-4929-9bea-205b90381abf service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:31.846921 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-940364b7-a47a-411e-a10a-23b44a3b7927 req-5474ae4a-277e-4929-9bea-205b90381abf service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:31.871805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.compute.rpcapi [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 20:28:31.884217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] Releasing lock "compute-rpcapi-router" {{(pid=120680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 20:28:31.890268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-940364b7-a47a-411e-a10a-23b44a3b7927 req-5474ae4a-277e-4929-9bea-205b90381abf service nova] Creating event network-changed:b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a for instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec on hv-cinder-84932 Sep 09 20:28:31.898229 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-940364b7-a47a-411e-a10a-23b44a3b7927 req-5474ae4a-277e-4929-9bea-205b90381abf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 20:28:31.898813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-940364b7-a47a-411e-a10a-23b44a3b7927 req-5474ae4a-277e-4929-9bea-205b90381abf service nova] Acquired lock "compute-rpcapi-router" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 20:28:31.903274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:31.905543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:31.906171 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:31.908301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:31.909848 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:31.911501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:31.935575 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7dc4a6ed-f7a3-423c-b19f-e9cc4b6a5225 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.807729 Sep 09 20:28:31.938399 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 32/52] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:31.957213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.compute.rpcapi [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 20:28:31.959825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:31.961008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] Releasing lock "compute-rpcapi-router" {{(pid=120679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 20:28:31.962106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:32.010732 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d9007f4-4374-4589-bc68-6cb4a75e9800 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.640042 Sep 09 20:28:32.010852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:32.011684 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 21/53] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:32.017907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:32.019632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:32.023854 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:32.026776 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:32.027955 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:32.031904 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:32.035145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:32.051274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:32.053845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:32.055828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:32.056940 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:32.060423 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:32.060806 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:32.895343 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:32.904676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-72606178-f2a6-447a-8c63-1bf99eddc2a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.964188 Sep 09 20:28:32.912134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 33/54] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:31 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:32.917114 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:32.930180 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:32.957613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:32.966435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:32.967741 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:32.973928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:32.975038 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:32.975743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:32.976392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:32.993602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f1f29453-2192-4c61-b4bc-8c002a547e61 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.976112 Sep 09 20:28:32.994193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 22/55] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:32 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:33.022665 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:33.024356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:33.044291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:33.052786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:33.064331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:33.069030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:33.073718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:33.074618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:33.079846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:33.634501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:33.643527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:33.647931 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:33.652704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c44daff6-f7c8-4c93-84f1-d17f52290ba3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1278 microversion: 2.20 time: 0.654486 Sep 09 20:28:33.658356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 23/56] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:32 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1278 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:33.751635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:33.770357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59ecd80e-378b-4064-b3d8-c5471e29a602 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1274 microversion: 2.1 time: 0.852071 Sep 09 20:28:33.773680 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 34/57] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:32 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1274 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:33.936342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:33.936888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:33.949530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:33.950023 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:33.959386 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:33.960217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:33.961537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:33.961983 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:34.023082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:34.024265 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:34.043896 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:34.047478 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:34.050745 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:34.052644 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:34.053561 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:34.054842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:34.406981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:34.419195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43e9c52e-e050-4fa0-ab22-f2e40d65a018 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.486722 Sep 09 20:28:34.434510 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 24/58] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:33 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:34.441842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:34.450867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbf471ed-1489-40c8-9434-ef2f6d0c9046 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.432280 Sep 09 20:28:34.452680 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 35/59] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:34 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:34.690329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:34.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:34.698397 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:34.698806 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:34.699240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:34.699999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:34.700553 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:34.700979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:34.771372 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:34.785584 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:34.787052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:34.792046 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72d99274-19c6-4de7-b9f4-7fe09eece3d1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1334 microversion: 2.20 time: 0.103961 Sep 09 20:28:34.793068 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 25/60] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:34 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:34.805172 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:34.807808 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:34.815281 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:34.815929 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:34.816545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:34.817604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:34.818542 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:34.819271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:34.909355 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:34.921785 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5a43038d-74e3-424f-bd96-158e4dd97812 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1280 microversion: 2.1 time: 0.125164 Sep 09 20:28:34.923031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 36/61] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:34 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:35.446252 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:35.446948 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:35.452922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.453508 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.454007 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:35.454770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.455288 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.455920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:35.477799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:35.482016 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:35.497295 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.502057 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.502691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:35.503426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.503883 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.504306 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:35.642354 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:35.651444 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-18627448-97a6-4255-b51f-3f5fd34146a0 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.209185 Sep 09 20:28:35.652128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 26/62] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:35 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:35.674556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:35.683734 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5328a698-affd-4171-bd45-4ae9bf95c941 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.209723 Sep 09 20:28:35.684596 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 37/63] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:35 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:35.822736 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:35.823336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:35.831823 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.832000 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.832601 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:35.833090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.833577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.833991 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:35.902257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:35.910165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:35.911631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:35.912703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5acb697c-785e-4817-b8b2-feb4a70a8c20 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1334 microversion: 2.20 time: 0.093874 Sep 09 20:28:35.913270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 27/64] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:35 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:35.946829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:35.947442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:35.954198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.954686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.955121 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:35.955815 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:35.956426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:35.956842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:36.024582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:36.034541 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3feaf067-94c3-41a6-af89-77e30f386603 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1280 microversion: 2.1 time: 0.094616 Sep 09 20:28:36.035101 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 38/65] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:35 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:36.676108 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:36.677357 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:36.684173 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:36.684760 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:36.685284 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:36.686054 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:36.686608 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:36.687145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:36.706022 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:36.707353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:36.713601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:36.714173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:36.714523 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:36.715214 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:36.715664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:36.716082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:36.916352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:36.929590 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1cb24c52-f667-44ab-abec-d25a03c95ff9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.257395 Sep 09 20:28:36.931248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 28/66] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:36 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:36.947271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:36.947878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:36.954173 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:36.954689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:36.955123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:36.955827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:36.956277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:36.956695 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:37.127031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:37.139567 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-278b36ff-7721-4c2a-b0f6-21e73e07c834 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.437258 Sep 09 20:28:37.140143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 39/67] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:36 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:37.159013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:37.160735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:37.162372 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:37.169764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:37.170892 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:37.171529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:37.172070 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:37.172270 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:37.173108 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:37.173221 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-053fb7b9-904a-459c-9eb8-73c9152554ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1334 microversion: 2.20 time: 0.229938 Sep 09 20:28:37.173820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:37.173968 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 29/68] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:36 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1334 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:28:37.174576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:37.268633 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:37.276248 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f443f2e-89ba-4d7d-8676-a83b440ac1ce tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1280 microversion: 2.1 time: 0.120958 Sep 09 20:28:37.276803 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 40/69] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:37 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:37.952631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:37.953383 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:37.960045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:37.960467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:37.961154 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:37.962027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:37.962637 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:37.963194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:38.099367 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:38.110986 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8dce115a-9889-4ac4-a5f1-5e42f3827f8b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.162853 Sep 09 20:28:38.111884 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 30/70] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:37 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:38.165940 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:38.166549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:38.169636 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:38.173384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:38.173859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:38.174287 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:38.174969 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:38.175419 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:38.175834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:38.199937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:38.200690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:38.206786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:38.207343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:38.207849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:38.208643 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:38.209165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:38.209617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:38.312101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:38.320102 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:38.321561 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:38.322640 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f4d20d70-5e5a-491f-b563-4de69fdc8c09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1334 microversion: 2.20 time: 0.126710 Sep 09 20:28:38.323190 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 31/71] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:38 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1334 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:38.327646 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:38.328245 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:38.333851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:38.334302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:38.334733 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:38.335403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:38.335881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:38.336294 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:38.341446 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:38.350702 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b5b61965-a3f4-4877-ae74-0a62306043ef tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.188499 Sep 09 20:28:38.351422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 41/72] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:38 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:38.412556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:38.420656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a8a35207-36b0-45af-9f9e-824190fc90ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1280 microversion: 2.1 time: 0.095868 Sep 09 20:28:38.421438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 32/73] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:38 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1280 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:39.135807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:39.136410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:39.142654 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.143127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.143559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.144309 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.144754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.145164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.290129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:39.293877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:39.300658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b8d43948-b4c9-467b-9a27-526ffefbf2d5 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.168602 Sep 09 20:28:39.313270 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 42/74] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:39 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:39.356043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:39.356675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:39.362792 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.363276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.363709 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.364400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.364852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.365286 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.374140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:39.374751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:39.380579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.381052 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.381513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.382197 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.382643 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.383065 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.429574 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:39.437897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:39.439329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:39.440443 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe416f43-2b3d-404e-98dc-3c318989f0ea tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1334 microversion: 2.20 time: 0.088409 Sep 09 20:28:39.441003 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 33/75] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:39 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:39.445392 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:39.445995 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:39.452456 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.453002 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.453403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.454093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:39.454546 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:39.454973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:39.459114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:39.532915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:39.541474 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fbafd379-ae6a-4a11-95b0-cc976ce0c5dc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1280 microversion: 2.1 time: 0.099261 Sep 09 20:28:39.548236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 34/76] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:39 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:39.580786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:39.588756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c012476-312b-4d95-abac-9fc98803bafe tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.218429 Sep 09 20:28:39.589373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 43/77] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:39 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:40.324238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:40.324836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:40.331579 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.332066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.332491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.333178 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.333900 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.334143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.466427 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:40.467759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:40.480785 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.481427 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.481999 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.483026 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.483559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.484356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.638500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:40.647855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:40.654683 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:40.655964 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-089611ab-4571-4fbb-a2cd-fede78d4b9ee tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1334 microversion: 2.20 time: 0.194183 Sep 09 20:28:40.657831 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 44/78] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:40 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1334 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:28:40.663876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:40.667842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:40.682001 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.693086 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.693720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.694598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.696071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.696071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.735947 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:40.743911 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-105a531d-87b1-4380-b9b6-51ea0a8cb6d1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.423553 Sep 09 20:28:40.751008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 35/79] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:40 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:40.755904 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:40.762274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:40.773726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.774593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.775340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.776451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:40.778298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:40.779179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:40.934746 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:40.947453 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bd8d2ae-b4f5-47fc-ad8d-15e1faf4ac98 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1280 microversion: 2.1 time: 0.287133 Sep 09 20:28:40.948046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 45/80] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:40 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:41.093813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:41.101802 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f12d705-5a20-4e52-8beb-ddc68da8be88 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.349452 Sep 09 20:28:41.115225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 36/81] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:40 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:41.686223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:41.686871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:41.690675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=28 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:41.701834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:41.702602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:41.703857 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:41.711951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:41.712691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:41.713357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:41.776184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:41.777497 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:41.787197 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=24 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:41.793175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:41.801920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:41.802428 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:41.803331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:41.804104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:41.807764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:41.869875 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:41.893943 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:41.903786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:41.909016 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:41.912091 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6675c5e0-f26f-4001-a8f6-df37b5e2cdfb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1334 microversion: 2.20 time: 0.230839 Sep 09 20:28:41.913051 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 46/82] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:41 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1334 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:41.947142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:41.975939 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:41.976781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:41.984985 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:41.985767 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:41.986516 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:41.987580 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:41.989266 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:41.989871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:42.168215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:42.183636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c47c6984-a362-453a-a6a1-d6a15280fc71 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.413347 Sep 09 20:28:42.198982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 37/83] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:41 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:42.211610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:42.225451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:42.234358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:42.235288 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:42.235956 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:42.236905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:42.237729 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:42.238355 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:42.537421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:42.548019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a6be750b-00c4-4905-a79a-98f43da694bc tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.577567 Sep 09 20:28:42.549500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 47/84] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:41 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:42.555894 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-628287b5-d1cb-4d84-b2e7-b4855cd8b0d3 req-238dcfa5-c174-48a8-bb3b-c08e7aa88c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5", "tag": "727b9f9f-0d7b-470a-ba5d-2023a0e7304d"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:42.570529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-628287b5-d1cb-4d84-b2e7-b4855cd8b0d3 req-238dcfa5-c174-48a8-bb3b-c08e7aa88c30 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:42.572151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-628287b5-d1cb-4d84-b2e7-b4855cd8b0d3 req-238dcfa5-c174-48a8-bb3b-c08e7aa88c30 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:42.574166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-628287b5-d1cb-4d84-b2e7-b4855cd8b0d3 req-238dcfa5-c174-48a8-bb3b-c08e7aa88c30 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:42.595006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-628287b5-d1cb-4d84-b2e7-b4855cd8b0d3 req-238dcfa5-c174-48a8-bb3b-c08e7aa88c30 service nova] Creating event network-changed:727b9f9f-0d7b-470a-ba5d-2023a0e7304d for instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 on hv-cinder-84932 Sep 09 20:28:42.601420 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-628287b5-d1cb-4d84-b2e7-b4855cd8b0d3 req-238dcfa5-c174-48a8-bb3b-c08e7aa88c30 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050384 Sep 09 20:28:42.602794 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 48/85] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:42.604802 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:42.613614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-66e8a10a-ce2e-45f6-acf4-5e8925bbabcf tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.408146 Sep 09 20:28:42.614405 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 38/86] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:42 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:42.896743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-23ff6483-1674-4384-b953-c4045b6d2db2 req-f4dd1e4e-269f-4f3a-ad1f-291ed31d099d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609ef31d-c755-46cf-9bd4-d5373f9cb78d", "tag": "ccc294b6-8a23-4205-8c36-01b2941e0c68"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:42.908375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-23ff6483-1674-4384-b953-c4045b6d2db2 req-f4dd1e4e-269f-4f3a-ad1f-291ed31d099d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:42.908948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-23ff6483-1674-4384-b953-c4045b6d2db2 req-f4dd1e4e-269f-4f3a-ad1f-291ed31d099d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:42.909604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-23ff6483-1674-4384-b953-c4045b6d2db2 req-f4dd1e4e-269f-4f3a-ad1f-291ed31d099d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:42.921345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-23ff6483-1674-4384-b953-c4045b6d2db2 req-f4dd1e4e-269f-4f3a-ad1f-291ed31d099d service nova] Creating event network-changed:ccc294b6-8a23-4205-8c36-01b2941e0c68 for instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d on hv-cinder-84932 Sep 09 20:28:42.926556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-23ff6483-1674-4384-b953-c4045b6d2db2 req-f4dd1e4e-269f-4f3a-ad1f-291ed31d099d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034161 Sep 09 20:28:42.927498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 49/87] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:42.944060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:42.944734 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:42.951435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:42.951923 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:42.952374 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:42.953067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:42.953546 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:42.953970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:43.025800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:43.035238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:43.036840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:43.038416 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-51fa7547-eafa-40e8-85c5-b3901a60ce0e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1352 microversion: 2.20 time: 0.100057 Sep 09 20:28:43.039297 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 39/88] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:42 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:43.220678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:43.222035 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:43.269017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:43.271238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:43.272811 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:43.273652 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:43.274106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:43.274714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:43.572438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:43.573155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:43.589332 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:43.589833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:43.590462 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:43.591464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:43.592827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:43.593471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:44.035159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:44.046465 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e69ca566-9e16-4810-82b1-cc71929fef3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.836955 Sep 09 20:28:44.047045 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 50/89] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:43 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:44.059376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:44.063356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:44.078201 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:44.078909 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:44.079510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:44.080372 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:44.080968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:44.081627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:44.148849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:44.162028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6b9ff136-86a3-4be0-aadb-e4402d50a59f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.593420 Sep 09 20:28:44.162624 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 40/90] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:43 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:44.170548 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:44.173364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:44.186615 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:44.188639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:44.189298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:44.192757 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:44.193301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:44.193810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:44.529281 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:44.539203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:44.545431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:44.546856 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-691ee8b7-f4a1-495d-a339-3419c609b46d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1340 microversion: 2.20 time: 0.383260 Sep 09 20:28:44.548997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 41/91] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:44 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1340 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:44.742834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:44.752640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec4b4c28-f6e5-4d47-9459-57d779799ec7 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.702000 Sep 09 20:28:44.766620 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 51/92] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:44 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:45.077705 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:45.078602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:45.088441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.089144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.089766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:45.091017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.092166 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.094561 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:45.188311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:45.188880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:45.201315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.202174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.202772 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:45.204273 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.204899 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.205499 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:45.749425 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:45.758806 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-807564ce-7985-4169-824a-cf5bc1801f0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.574863 Sep 09 20:28:45.760849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:45.770673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c70d9654-8bcc-4964-9bf3-414e5627b193 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.698848 Sep 09 20:28:45.778395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 42/93] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:45 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:45.784390 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:45.790359 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:45.799445 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 52/94] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:45 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:45.802570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.803448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.805759 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:45.806839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.807503 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.809789 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:45.819167 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:45.820933 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:45.835590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.836442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.838860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:45.839491 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:45.840023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:45.842459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:46.417468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:46.426062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:46.427533 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:46.428656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4f7e6215-18fe-4e46-97f7-1717e46e4eeb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.648189 Sep 09 20:28:46.441496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 43/95] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:45 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:46.470439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:46.486055 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3e1374d2-105a-40f3-be18-e9897adcb8df tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.685050 Sep 09 20:28:46.486626 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 53/96] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:45 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:46.796647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:46.797392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:46.806529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:46.812712 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:46.813272 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:46.814087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:46.814614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:46.815110 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:46.943483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-48217728-2832-4bf5-8699-993e6fcbdd2f req-2c295171-37a9-45c2-a993-a3fa6fb27101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3294b2ee-c133-4483-a732-1b10f1130e44", "name": "network-vif-plugged", "status": "completed", "tag": "92ac06aa-3b8a-4813-af77-d204e8112bb0"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:46.961834 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-48217728-2832-4bf5-8699-993e6fcbdd2f req-2c295171-37a9-45c2-a993-a3fa6fb27101 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:46.963814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-48217728-2832-4bf5-8699-993e6fcbdd2f req-2c295171-37a9-45c2-a993-a3fa6fb27101 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:46.964551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-48217728-2832-4bf5-8699-993e6fcbdd2f req-2c295171-37a9-45c2-a993-a3fa6fb27101 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:46.983333 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-48217728-2832-4bf5-8699-993e6fcbdd2f req-2c295171-37a9-45c2-a993-a3fa6fb27101 service nova] Creating event network-vif-plugged:92ac06aa-3b8a-4813-af77-d204e8112bb0 for instance 3294b2ee-c133-4483-a732-1b10f1130e44 on hv-cinder-84932 Sep 09 20:28:46.991800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-48217728-2832-4bf5-8699-993e6fcbdd2f req-2c295171-37a9-45c2-a993-a3fa6fb27101 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304148 Sep 09 20:28:46.998425 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 44/97] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:47.006439 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:47.007851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:47.033314 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:47.035175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:47.035781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:47.036644 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:47.037112 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:47.037570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:47.157053 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:47.179539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3b7f85b1-386a-4431-9c24-701d48e1b13d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.383689 Sep 09 20:28:47.180987 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 54/98] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:46 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:47.459837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:47.461040 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:47.472370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:47.472918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:47.473415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:47.475594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:47.476969 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:47.477749 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:47.651227 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:47.679699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-717044ee-9260-47fb-833e-73d34156385f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.678967 Sep 09 20:28:47.680280 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 45/99] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:46 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:47.685373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:47.686284 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:47.695639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:47.709549 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:47.710070 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:47.711837 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:47.714045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:47.714482 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:47.872299 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:47.887813 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:47.890439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:47.892423 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ce7d580d-838d-4db6-b89e-50c19f102c62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.437929 Sep 09 20:28:47.893622 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 55/100] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:47 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:28:48.032516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:48.048321 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-adb295d2-c2d2-42ce-825b-d8d943da4d49 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.365924 Sep 09 20:28:48.049630 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 46/101] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:47 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:48.203785 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:48.204459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:48.212374 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:48.212871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:48.213322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:48.214557 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:48.215009 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:48.219855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:48.223269 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-484d642c-efbb-4a98-b81d-2e27b7516514 req-ac3923ca-11f7-42cb-825d-ab3a80a82655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe125d2-51c7-4732-aa2a-90ab2d85d05f", "tag": "715458c7-e2c5-47e3-9ee4-1e82cbf7d53e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:48.259922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-484d642c-efbb-4a98-b81d-2e27b7516514 req-ac3923ca-11f7-42cb-825d-ab3a80a82655 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:48.260417 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-484d642c-efbb-4a98-b81d-2e27b7516514 req-ac3923ca-11f7-42cb-825d-ab3a80a82655 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:48.260852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-484d642c-efbb-4a98-b81d-2e27b7516514 req-ac3923ca-11f7-42cb-825d-ab3a80a82655 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:48.288519 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-484d642c-efbb-4a98-b81d-2e27b7516514 req-ac3923ca-11f7-42cb-825d-ab3a80a82655 service nova] Creating event network-changed:715458c7-e2c5-47e3-9ee4-1e82cbf7d53e for instance abe125d2-51c7-4732-aa2a-90ab2d85d05f on hv-cinder-84932 Sep 09 20:28:48.300752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-484d642c-efbb-4a98-b81d-2e27b7516514 req-ac3923ca-11f7-42cb-825d-ab3a80a82655 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081732 Sep 09 20:28:48.301982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 47/102] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:28:48.610632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:48.620202 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0c07b60a-d623-433e-8c8d-409c0d9e7119 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.421078 Sep 09 20:28:48.621081 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 56/103] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:48 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:48.708430 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:48.709434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:48.718005 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:48.719052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:48.719982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:48.721152 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:48.721852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:48.722502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:48.918312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:48.919184 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:48.926511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:48.927777 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:48.928266 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:48.928970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:48.929434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:48.929574 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:48.929919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:48.938833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-220317fe-01ac-4c74-8e05-a20662d0936d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.239332 Sep 09 20:28:48.941729 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 48/104] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:48 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:49.008858 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f741000b-0aa7-427a-8734-06581871a27c req-6893b0fe-b72a-4171-8553-f4ad099ea061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0ef033-9a7a-4b4d-8c77-2e52b202adec", "name": "network-vif-plugged", "status": "completed", "tag": "b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:49.023577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f741000b-0aa7-427a-8734-06581871a27c req-6893b0fe-b72a-4171-8553-f4ad099ea061 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:49.024403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f741000b-0aa7-427a-8734-06581871a27c req-6893b0fe-b72a-4171-8553-f4ad099ea061 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:49.025029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f741000b-0aa7-427a-8734-06581871a27c req-6893b0fe-b72a-4171-8553-f4ad099ea061 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:49.039855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f741000b-0aa7-427a-8734-06581871a27c req-6893b0fe-b72a-4171-8553-f4ad099ea061 service nova] Creating event network-vif-plugged:b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a for instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec on hv-cinder-84932 Sep 09 20:28:49.045662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f741000b-0aa7-427a-8734-06581871a27c req-6893b0fe-b72a-4171-8553-f4ad099ea061 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040587 Sep 09 20:28:49.046690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 49/105] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:28:49.071956 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:49.072899 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:49.080798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:49.081557 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:49.081996 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:49.082744 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:49.083345 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:49.083920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:49.087784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:49.096673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:49.098551 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:49.100159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6132fe57-2e30-42ce-810a-8531dbadbb84 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.186912 Sep 09 20:28:49.114137 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 57/106] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:48 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:28:49.372926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:49.383490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a887ec70-0529-4505-846f-95352482a6ec tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.315126 Sep 09 20:28:49.384788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 50/107] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:49 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:49.660008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:49.660657 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:49.676628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:49.678686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:49.680065 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:49.681672 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:49.682346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:49.683150 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:49.879203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:49.890358 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd79c4b7-dece-4e37-8269-8d4f9f6d07a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.242886 Sep 09 20:28:49.895208 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 58/108] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:49 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:49.964315 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:49.964972 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:49.990835 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:49.992216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:49.993086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:49.994346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:49.995131 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:49.996223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:50.128139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:50.128756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:50.135879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:50.136363 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:50.137194 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:50.140401 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:50.141958 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:50.144136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:50.369194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:50.382670 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb850645-60fe-442d-8f39-3cf1f5f18783 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.422403 Sep 09 20:28:50.383447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 51/109] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:49 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:50.416660 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:50.419196 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:50.419914 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:50.431202 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:50.431689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:50.432319 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:50.433237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:50.433392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:50.434861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:50.435808 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:50.436603 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:50.440810 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f660028f-0493-4514-8991-cc541c03eb70 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.316471 Sep 09 20:28:50.441419 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 59/110] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:50 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:28:50.632978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:50.639084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:50.646859 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8bccab22-1ce4-4de7-9b3f-136d2f36d990 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1315 microversion: 2.1 time: 0.236924 Sep 09 20:28:50.647892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 52/111] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:50 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:50.921908 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:50.922525 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:50.929133 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:50.929648 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:50.930264 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:50.931152 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:50.931788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:50.932456 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:51.063318 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-aed4b99c-c738-4a60-b1d5-f8e69333a992 req-3e6d2b68-db4d-47ca-a026-c98111d47508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609ef31d-c755-46cf-9bd4-d5373f9cb78d", "name": "network-vif-plugged", "status": "completed", "tag": "ccc294b6-8a23-4205-8c36-01b2941e0c68"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:51.092934 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aed4b99c-c738-4a60-b1d5-f8e69333a992 req-3e6d2b68-db4d-47ca-a026-c98111d47508 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:51.093468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aed4b99c-c738-4a60-b1d5-f8e69333a992 req-3e6d2b68-db4d-47ca-a026-c98111d47508 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:51.093904 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-aed4b99c-c738-4a60-b1d5-f8e69333a992 req-3e6d2b68-db4d-47ca-a026-c98111d47508 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:51.132008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-aed4b99c-c738-4a60-b1d5-f8e69333a992 req-3e6d2b68-db4d-47ca-a026-c98111d47508 service nova] Creating event network-vif-plugged:ccc294b6-8a23-4205-8c36-01b2941e0c68 for instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d on hv-cinder-84932 Sep 09 20:28:51.138466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-aed4b99c-c738-4a60-b1d5-f8e69333a992 req-3e6d2b68-db4d-47ca-a026-c98111d47508 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079512 Sep 09 20:28:51.141061 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 53/112] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:51.199496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:51.210781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:51.213082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3d8e39e-cb58-4ab8-837a-0a87cf0d832a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1362 microversion: 2.1 time: 0.296501 Sep 09 20:28:51.218283 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 60/113] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:50 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:51.407651 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:51.408342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:51.415016 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:51.415494 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:51.416092 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:51.417637 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:51.418245 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:51.418903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:51.473607 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:51.474453 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:51.483857 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:51.485716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:51.487158 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:51.490086 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:51.491305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:51.492175 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:51.905115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:51.916100 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c75efb0d-2a3f-4e23-bd40-1713384ffac0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.512517 Sep 09 20:28:51.917308 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 54/114] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:51 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:51.922363 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:51.923447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:51.929866 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:51.930618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:51.931282 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:51.932187 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:51.932853 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:51.933502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:52.213770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:52.225576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:52.229222 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:52.233130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69c409a3-74c5-496d-9b46-de92f50d80d5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.764748 Sep 09 20:28:52.253281 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 61/115] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:51 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:28:52.262371 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:52.262371 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:52.275474 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:52.276964 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:52.278351 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:52.279319 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:52.279914 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:52.280619 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:52.321380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:52.330208 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0530e041-b4fb-4147-88a8-fbc2b4508fe4 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1502 microversion: 2.1 time: 0.411548 Sep 09 20:28:52.345504 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 55/116] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:51 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:52.564615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:52.576488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-71f65104-dedd-4137-8266-1a0b2bd32875 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1548 microversion: 2.1 time: 0.335685 Sep 09 20:28:52.577131 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 62/117] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:52 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1548 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:52.608283 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:52.608790 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:52.622930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:52.626048 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:52.626506 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:52.627243 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:52.627708 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:52.632569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:52.926893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aeceaef2-5783-4cfd-b6e0-b5c9ef137f12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.323334 Sep 09 20:28:52.927828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 56/118] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:28:52 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-interface => generated 284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:52.942843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:52.943737 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:52.957725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:52.959806 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:52.962066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:52.963771 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:52.965593 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:52.968285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:53.155845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-920411f2-e3be-4912-acec-6bc22577d173 req-ae176d0b-cad5-4f80-ac4c-efde0e81178b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5", "name": "network-vif-plugged", "status": "completed", "tag": "727b9f9f-0d7b-470a-ba5d-2023a0e7304d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:53.167008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-920411f2-e3be-4912-acec-6bc22577d173 req-ae176d0b-cad5-4f80-ac4c-efde0e81178b service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:53.167484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-920411f2-e3be-4912-acec-6bc22577d173 req-ae176d0b-cad5-4f80-ac4c-efde0e81178b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:53.168651 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-920411f2-e3be-4912-acec-6bc22577d173 req-ae176d0b-cad5-4f80-ac4c-efde0e81178b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:53.185727 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-920411f2-e3be-4912-acec-6bc22577d173 req-ae176d0b-cad5-4f80-ac4c-efde0e81178b service nova] Creating event network-vif-plugged:727b9f9f-0d7b-470a-ba5d-2023a0e7304d for instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 on hv-cinder-84932 Sep 09 20:28:53.193713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-920411f2-e3be-4912-acec-6bc22577d173 req-ae176d0b-cad5-4f80-ac4c-efde0e81178b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041789 Sep 09 20:28:53.195033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 57/119] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:53.273656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:53.275350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:53.308298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:53.309302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:53.309749 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:53.311126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:53.311701 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:53.312122 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:53.914098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:53.925614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cbd57a6c-b602-446e-aab7-9cf0f121071d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.987199 Sep 09 20:28:53.926989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 63/120] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:52 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:54.017695 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:54.029316 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:54.031357 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:54.033396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-353a36ef-17ff-4086-9ae4-b986aea1c5c3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.765875 Sep 09 20:28:54.039698 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c61323-5be9-4104-aef7-2dd354796eff"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:54.042152 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:54.046784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 58/121] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:53 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:54.050917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:54.051394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:54.051822 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:54.052499 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:54.053315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:54.055949 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:54.952059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:54.952877 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:54.964575 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:54.965707 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:54.967071 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:54.967882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:54.968337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:54.968754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:55.451094 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:55.461986 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6cc3fb46-23b8-42d8-a0c1-ef2516894e2b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.514250 Sep 09 20:28:55.469582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 59/122] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:54 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:55.480161 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:55.484238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:55.510629 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:55.514329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:55.515022 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:55.516861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:55.517606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:55.518394 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:55.709096 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:55.717818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:55.719328 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:55.720380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-579776ac-7f18-4a5a-8f2a-8c6f5536c7c0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.249628 Sep 09 20:28:55.722990 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 60/123] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:55 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:55.728488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8a5c7a79-42bf-4331-8c5a-0457576507c7 req-41564e75-fa3c-4502-b86c-ee9519b24723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe125d2-51c7-4732-aa2a-90ab2d85d05f", "name": "network-vif-plugged", "status": "completed", "tag": "715458c7-e2c5-47e3-9ee4-1e82cbf7d53e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:55.746469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8a5c7a79-42bf-4331-8c5a-0457576507c7 req-41564e75-fa3c-4502-b86c-ee9519b24723 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:55.748132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8a5c7a79-42bf-4331-8c5a-0457576507c7 req-41564e75-fa3c-4502-b86c-ee9519b24723 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:55.748562 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8a5c7a79-42bf-4331-8c5a-0457576507c7 req-41564e75-fa3c-4502-b86c-ee9519b24723 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:55.771536 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8a5c7a79-42bf-4331-8c5a-0457576507c7 req-41564e75-fa3c-4502-b86c-ee9519b24723 service nova] Creating event network-vif-plugged:715458c7-e2c5-47e3-9ee4-1e82cbf7d53e for instance abe125d2-51c7-4732-aa2a-90ab2d85d05f on hv-cinder-84932 Sep 09 20:28:55.780075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8a5c7a79-42bf-4331-8c5a-0457576507c7 req-41564e75-fa3c-4502-b86c-ee9519b24723 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055416 Sep 09 20:28:55.784780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 61/124] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:55.791059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4626337d-c845-4831-b0c9-60f09f911f01 req-29deeae5-2a4f-4414-a23c-abe408a9fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0ef033-9a7a-4b4d-8c77-2e52b202adec", "tag": "b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:55.805407 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4626337d-c845-4831-b0c9-60f09f911f01 req-29deeae5-2a4f-4414-a23c-abe408a9fd65 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:55.805883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4626337d-c845-4831-b0c9-60f09f911f01 req-29deeae5-2a4f-4414-a23c-abe408a9fd65 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:55.806318 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4626337d-c845-4831-b0c9-60f09f911f01 req-29deeae5-2a4f-4414-a23c-abe408a9fd65 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:55.821043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4626337d-c845-4831-b0c9-60f09f911f01 req-29deeae5-2a4f-4414-a23c-abe408a9fd65 service nova] Creating event network-changed:b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a for instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec on hv-cinder-84932 Sep 09 20:28:55.827954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4626337d-c845-4831-b0c9-60f09f911f01 req-29deeae5-2a4f-4414-a23c-abe408a9fd65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041798 Sep 09 20:28:55.829670 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 62/125] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:56.495017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:56.496323 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:56.503178 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:56.503827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:56.504417 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:56.505400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:56.506098 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:56.506670 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:57.101440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6fe606e8-9930-47e6-bca2-f700bf79df52 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "POST /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.065380 Sep 09 20:28:57.103900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 64/126] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:28:54 2022] POST /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44/os-volume_attachments => generated 194 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:28:57.138748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:57.142605 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:57.178557 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:57.180537 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:57.181701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:57.195550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:57.198922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:57.201031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:57.458135 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:57.468963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-821f4d55-fb93-4c93-8852-32b62ab8057e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1322 microversion: 2.1 time: 0.978534 Sep 09 20:28:57.470169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 63/127] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:56 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1322 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:57.475336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-393164031", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "networks": [{"uuid": "2cbef6b9-0698-42fe-962c-df7eb81f10bf"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:57.487018 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:57.501799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:57.503225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:57.506264 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-859e9915-3162-4cef-b6e1-c8c3f4a91726 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.400917 Sep 09 20:28:57.508749 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 65/128] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:57 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:28:57.558474 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] validate_networks() for [('2cbef6b9-0698-42fe-962c-df7eb81f10bf', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:28:57.958851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:28:57.959337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:28:57.959878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:28:57.960354 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:28:57.960825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:28:57.970779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:57.971298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:57.971689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:57.972393 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:57.972848 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:57.973283 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:57.992343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Getting quotas for project 32c862d7b7b242f699139ac0821867a8. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:28:57.997137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Getting quotas for user 892bbd02129b417c987f4d429e21a833 and project 32c862d7b7b242f699139ac0821867a8. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:28:58.009850 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:28:58.012288 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:28:58.065402 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-36ab2898-a81c-47c3-afa5-0399012582ed tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593846 Sep 09 20:28:58.066007 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 64/129] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:28:58.078381 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35a9a157-3aa2-4ce1-9c2d-cf27de1c6adc tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:58.079278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35a9a157-3aa2-4ce1-9c2d-cf27de1c6adc tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:58.146772 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-35a9a157-3aa2-4ce1-9c2d-cf27de1c6adc tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:58.158290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35a9a157-3aa2-4ce1-9c2d-cf27de1c6adc tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1213 microversion: 2.1 time: 0.082862 Sep 09 20:28:58.159535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 66/130] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:58 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:58.493689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:58.494505 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:58.501875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.503034 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.503632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:58.504586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.505126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.505815 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:58.536372 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:58.537511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:58.548345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.551676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.552912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:58.553942 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.554401 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.554819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:58.724223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:58.738050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5b8827f1-4a57-4ae4-bf88-6aa7a6df5645 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1517 microversion: 2.1 time: 0.248528 Sep 09 20:28:58.739062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 65/131] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:58 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:58.753656 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:58.764655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:58.766159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:58.766930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:28:58.767579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a3fae11-2986-49ac-8b55-51312f39bd0b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.237110 Sep 09 20:28:58.768201 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 67/132] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:58 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:28:58.770328 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:58.774260 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:28:58.778588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.779225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.780222 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:58.781386 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.781992 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.782564 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:58.806442 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lazy-loading 'flavor' on Instance uuid 609ef31d-c755-46cf-9bd4-d5373f9cb78d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:28:58.951975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6532189-caba-44e2-9674-22d2dd860570 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d/action" status: 200 len: 32 microversion: 2.1 time: 0.190760 Sep 09 20:28:58.953022 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 66/133] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:28:58 2022] POST /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 20:28:58.962065 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:58.962648 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:58.969125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.969667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.970117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:58.970969 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:58.971413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:58.972158 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:59.173781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:59.182088 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:59.182775 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:59.183592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-419f2abd-40a9-46a2-87dd-919e6d16e996 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.224990 Sep 09 20:28:59.184164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 68/134] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:58 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:28:59.189619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:59.190118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:59.190716 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:59.191392 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:59.191838 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:59.192617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:59.264821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:59.272567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4bfad41a-3f9e-4f56-ade4-19cad2d24129 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1217 microversion: 2.1 time: 0.094555 Sep 09 20:28:59.273596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 67/135] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:28:59 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:28:59.793653 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:28:59.794429 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:28:59.800922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:59.801526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:59.801956 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:59.802641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:28:59.803119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:28:59.803501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:28:59.928529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:59.937000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:59.938457 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:28:59.939540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2297d380-0d6a-465f-8b2e-5e32ad1ee1b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.150775 Sep 09 20:28:59.940095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 69/136] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:28:59 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:29:00.206707 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:00.207307 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:00.213134 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:00.213638 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:00.214064 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:00.214731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:00.215172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:00.215583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:00.296397 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:00.297041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:00.303421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:00.303898 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:00.304360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:00.305053 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:00.305532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:00.305952 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:00.371593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:00.373974 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:00.380752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1df9df26-7f69-4de4-adf7-807671dcfcd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.177627 Sep 09 20:29:00.381837 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 68/137] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:00 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:00.382275 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-446f5c59-1b3f-48c4-8269-3ddce1109ef4 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1217 microversion: 2.1 time: 0.090430 Sep 09 20:29:00.383702 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 70/138] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:00 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:00.964393 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:00.965147 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:00.971739 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:00.972272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:00.972756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:00.973523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:00.974035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:00.974542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:01.103510 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:01.113032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:01.114557 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:01.115960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-672af756-4ca6-44e3-ad3e-65c4509c1dd0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1408 microversion: 2.20 time: 0.155193 Sep 09 20:29:01.116757 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 69/139] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:29:00 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:29:01.418229 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:01.420615 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:01.421134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:01.422386 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:01.436338 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:01.436690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:01.437911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:01.438060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:01.439274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:01.440021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:01.440211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:01.441519 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:01.442729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:01.443084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:01.443649 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:01.444262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:01.567432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:01.576691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d7f5f2c-4ba8-4e0a-bcd4-1dacab5a96f1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1217 microversion: 2.1 time: 0.168804 Sep 09 20:29:01.577286 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 71/140] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:01 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:01.658607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:01.667614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b5a35753-4f37-4396-87b6-7e84a395d753 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.257686 Sep 09 20:29:01.668532 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 70/141] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:01 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:02.148774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:02.149300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:02.155403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.156531 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.156975 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.158213 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.158709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.159139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.312994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:02.322699 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:02.324269 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:02.326079 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0f97679-dde7-4604-8c7a-cacc379a20ba tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1601 microversion: 2.20 time: 0.187947 Sep 09 20:29:02.326807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 72/142] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:29:02 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1601 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:29:02.351279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:02.351764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:02.358198 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.358675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.359099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.359858 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.360517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.361659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.365943 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:02.446085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f503f8f0-5840-42f7-a2b7-e6c43e3f1fe0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098362 Sep 09 20:29:02.448771 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 71/143] 10.222.0.26 () {60 vars in 1316 bytes} [Fri Sep 9 20:29:02 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:29:02.605788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:02.607043 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:02.614305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.615185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.616077 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.617015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.617652 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.618222 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.695459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:02.696542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:02.703146 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.703629 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.704053 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.704809 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:02.705291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:02.705766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:02.758272 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:02.768620 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4ac78aa-4a54-4260-87dd-772c3390d7b7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1265 microversion: 2.1 time: 0.167033 Sep 09 20:29:02.771671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 73/144] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:02 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:02.970580 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:02.979366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0c2d1ff7-7d9a-4045-af06-4f0ef7f79654 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.287703 Sep 09 20:29:02.980174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 72/145] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:02 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:03.622943 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-9684d6c3-cb9d-4db0-b7b5-2c4531123fb8 req-60fd721c-6082-41af-90e6-5a32eec5083d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe125d2-51c7-4732-aa2a-90ab2d85d05f", "tag": "715458c7-e2c5-47e3-9ee4-1e82cbf7d53e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:03.635394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9684d6c3-cb9d-4db0-b7b5-2c4531123fb8 req-60fd721c-6082-41af-90e6-5a32eec5083d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:03.636085 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9684d6c3-cb9d-4db0-b7b5-2c4531123fb8 req-60fd721c-6082-41af-90e6-5a32eec5083d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:03.636762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-9684d6c3-cb9d-4db0-b7b5-2c4531123fb8 req-60fd721c-6082-41af-90e6-5a32eec5083d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:03.648833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-9684d6c3-cb9d-4db0-b7b5-2c4531123fb8 req-60fd721c-6082-41af-90e6-5a32eec5083d service nova] Creating event network-changed:715458c7-e2c5-47e3-9ee4-1e82cbf7d53e for instance abe125d2-51c7-4732-aa2a-90ab2d85d05f on hv-cinder-84932 Sep 09 20:29:03.656855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-9684d6c3-cb9d-4db0-b7b5-2c4531123fb8 req-60fd721c-6082-41af-90e6-5a32eec5083d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037984 Sep 09 20:29:03.657809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 74/146] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:03.793120 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:03.793785 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:03.801451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:03.801935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:03.802413 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:03.803156 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:03.803600 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:03.804015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:03.870761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:03.879075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9e37519-6a5c-4e6c-88f6-2a12f05b7baa tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1265 microversion: 2.1 time: 0.090243 Sep 09 20:29:03.879813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 73/147] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:03 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:04.006786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:04.007846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:04.019812 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:04.026233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:04.026972 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:04.028080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:04.029502 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:04.030083 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:04.218342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:04.226750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5d25bb2c-fc64-4362-9bc2-00efd183451f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.226924 Sep 09 20:29:04.227443 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 75/148] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:03 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:04.904320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:04.904922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:04.910966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:04.911441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:04.911868 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:04.912581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:04.913031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:04.913470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:04.978495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:04.986168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf37a0d5-8f2f-4a14-8c01-5ed86a6850d7 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1265 microversion: 2.1 time: 0.086627 Sep 09 20:29:04.986730 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 74/149] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:04 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:05.250516 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:05.251641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:05.258160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:05.258649 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:05.259063 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:05.259751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:05.260200 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:05.260617 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:05.404727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:05.412632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a32c070d-d40b-4d09-9ea9-2399c4d64f6d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.166579 Sep 09 20:29:05.413178 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 76/150] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:05 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:06.008048 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:06.009445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:06.023852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:06.024769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:06.025426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:06.026287 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:06.026739 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:06.027163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:06.200652 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:06.209551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cf0e4271-2bd7-48b3-bc13-041a7e72cf0c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1265 microversion: 2.1 time: 0.205303 Sep 09 20:29:06.221698 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 75/151] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:06 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:06.434188 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:06.435408 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:06.442798 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:06.443284 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:06.443719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:06.444597 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:06.445056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:06.445514 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:06.790191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:06.798092 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:06.820925 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-096703d3-48b2-4cf4-ab0c-b058f6150a02 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.388829 Sep 09 20:29:06.840048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 77/152] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:06 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:07.241880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:07.243021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:07.249685 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:07.250370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:07.250922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:07.251806 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:07.252262 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:07.252688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:07.427827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:07.444238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-21facfa2-f568-4b95-bdee-0bd868fe7c21 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1271 microversion: 2.1 time: 0.213019 Sep 09 20:29:07.444846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 76/153] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:07 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:07.852706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:07.854100 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:07.867759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:07.868592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:07.869318 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:07.870899 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:07.872398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:07.873098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:08.070410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:08.093164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a050cdd5-8c03-4f6d-9fc8-09948d48d86c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.244990 Sep 09 20:29:08.097701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 78/154] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:07 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:08.468480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:08.469090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:08.470949 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:08.471704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:08.477112 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:08.477629 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:08.478062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:08.478745 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:08.479192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:08.479610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:08.609262 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:08.617027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b40b4bc5-f68b-451a-8672-7e3b4943b9bf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.152976 Sep 09 20:29:08.617618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 77/155] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:08 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:09.124885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:09.125511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:09.127389 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:09.128578 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=77 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:09.134734 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:09.135222 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:09.135651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:09.136341 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:09.136786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:09.137198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:09.270268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:09.277890 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c191e85-1361-4540-97f2-4a507f40ff25 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.157514 Sep 09 20:29:09.278458 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 79/156] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:09 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:09.639483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:09.640084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:09.646027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:09.646523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:09.646945 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:09.647613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:09.648050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:09.648462 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:09.774787 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:09.782764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79e7ceea-1e93-4902-9d86-73e5e599bf5a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.147236 Sep 09 20:29:09.783316 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 78/157] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:09 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:10.300403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:10.301008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:10.307371 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:10.307847 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:10.308279 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:10.308956 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:10.309475 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:10.309897 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:10.444302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:10.452539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-29dfcd1a-3970-4221-8e4c-00a5c9623891 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.155924 Sep 09 20:29:10.453102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 80/158] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:10 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:10.805834 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:10.806432 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:10.813156 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:10.813680 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:10.814112 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:10.814812 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:10.815264 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:10.815685 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:10.940930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:10.948521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d06ead5d-b4aa-450c-a9ed-d0456b646e4c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.146614 Sep 09 20:29:10.949090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 79/159] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:10 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:11.474237 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:11.474753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:11.481651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:11.482129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:11.482558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:11.483241 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:11.483687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:11.484106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:11.620166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:11.627714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c058418a-2ef6-4778-8df7-8dd6dfdaf5db tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.157416 Sep 09 20:29:11.628275 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 81/160] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:11 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:11.971125 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:11.971763 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:11.977639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:11.978114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:11.978539 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:11.979219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:11.979662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:11.980069 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:12.115782 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:12.126349 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c127bceb-86d8-4e06-a647-23b4df3a09cf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.158838 Sep 09 20:29:12.127124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 80/161] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:11 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:12.325632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ce49d0db-b4be-4db0-a04f-81e53cafa1b4 req-8c9c87f9-4412-4cf8-9997-54af99d6e2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1572e9f8-bd24-42ae-9c0e-d0a659792412", "tag": "5c2aa298-150f-4083-9c05-cc091fc750a6"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:12.338159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ce49d0db-b4be-4db0-a04f-81e53cafa1b4 req-8c9c87f9-4412-4cf8-9997-54af99d6e2f4 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:12.338801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ce49d0db-b4be-4db0-a04f-81e53cafa1b4 req-8c9c87f9-4412-4cf8-9997-54af99d6e2f4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:12.339366 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ce49d0db-b4be-4db0-a04f-81e53cafa1b4 req-8c9c87f9-4412-4cf8-9997-54af99d6e2f4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:12.367692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ce49d0db-b4be-4db0-a04f-81e53cafa1b4 req-8c9c87f9-4412-4cf8-9997-54af99d6e2f4 service nova] Creating event network-changed:5c2aa298-150f-4083-9c05-cc091fc750a6 for instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 on hv-cinder-84932 Sep 09 20:29:12.375936 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ce49d0db-b4be-4db0-a04f-81e53cafa1b4 req-8c9c87f9-4412-4cf8-9997-54af99d6e2f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054889 Sep 09 20:29:12.377681 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 82/162] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:12.650412 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:12.651025 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:12.657564 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:12.658048 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:12.658542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:12.659235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:12.659688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:12.660108 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:12.794924 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:12.802613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9eaa2476-a63a-4615-a13a-120c6d2cf1aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.156028 Sep 09 20:29:12.803476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 81/163] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:12 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:13.152685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:13.153887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:13.160633 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:13.161115 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:13.161576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:13.162269 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:13.162720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:13.163142 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:13.305084 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:13.314023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1fcb69e4-ed38-4aa4-9aa8-f0c6aef73443 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.166327 Sep 09 20:29:13.314596 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 83/164] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:13 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:13.826741 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:13.827551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:13.834444 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:13.835151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:13.835975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:13.836847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:13.837435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:13.837928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:14.031253 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:14.042306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de3e2e09-1d13-4c1f-8a82-e982195757ac tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.219398 Sep 09 20:29:14.057270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 82/165] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:13 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:14.336875 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:14.338170 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:14.344813 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:14.345228 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:14.345982 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:14.346677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:14.347280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:14.347853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:14.531937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:14.541038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:14.541263 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82911e91-ed30-4060-b486-52609122decb tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.208294 Sep 09 20:29:14.541606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:14.542095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 84/166] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:14 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:14.548286 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:14.548761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:14.549185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:14.549921 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:14.550366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:14.550773 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:14.577396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:29:14.667299 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d8b1419-4fb1-4565-bf0c-e66e111175cc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 204 len: 0 microversion: 2.1 time: 0.131096 Sep 09 20:29:14.668012 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 83/167] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:29:14 2022] DELETE /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 20:29:14.676507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:14.677926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:14.683597 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:14.684126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:14.684554 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:14.685275 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:14.685736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:14.686159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:14.829943 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:14.838164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d0ddae0-1309-4e17-8079-97e6048be8fc tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1554 microversion: 2.1 time: 0.165593 Sep 09 20:29:14.838727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 85/168] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:14 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:15.067970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:15.068662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:15.075195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:15.075672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:15.076103 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:15.076781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:15.077230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:15.077676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:15.208744 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:15.216409 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29e9b797-2d0a-4d82-8eb0-d0fb7de15f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.152653 Sep 09 20:29:15.216975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 84/169] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:15 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:15.564620 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:15.565225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:15.571654 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:15.572132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:15.572564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:15.573327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:15.573721 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:15.574139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:15.700319 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:15.708136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4eb2e846-dcf2-4dcf-a966-289b38da998d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.147532 Sep 09 20:29:15.708695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 86/170] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:15 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:15.861778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:15.862652 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:15.869447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:15.869928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:15.870358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:15.871043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:15.871978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:15.872424 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:16.005798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:16.014534 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-afaab385-8ff2-482e-89d2-f052af5b17d2 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1554 microversion: 2.1 time: 0.156966 Sep 09 20:29:16.015108 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 85/171] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:15 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:16.238701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:16.239299 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:16.245384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:16.245862 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:16.246288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:16.247542 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:16.247984 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:16.248397 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:16.373526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:16.381106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e704470-3565-43d3-8f98-9a201be7a390 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.146174 Sep 09 20:29:16.381701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 87/172] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:16 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:16.732540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:16.733170 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:16.739185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:16.739660 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:16.740086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:16.741025 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:16.741492 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:16.741911 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:16.762960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:16.905663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:16.913754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0d6aa5e1-361c-4c0f-aca5-8d80f6eedfef tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.185640 Sep 09 20:29:16.914618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 86/173] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:16 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:17.037618 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:17.038251 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:17.045142 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:17.045664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:17.046091 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:17.046771 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:17.047221 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:17.047640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:17.172452 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:17.180827 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa187554-8f33-40ec-85e2-16bd01c4acab tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1554 microversion: 2.1 time: 0.147082 Sep 09 20:29:17.181341 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 88/174] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:17 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:17.404857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:17.405505 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:17.411387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:17.411863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:17.412295 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:17.412975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:17.413465 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:17.413887 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:17.541026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:17.549278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-146c1e3f-5707-4211-9605-641cd00b7a87 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.148746 Sep 09 20:29:17.549845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 87/175] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:17 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:17.936327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:17.937015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:17.943278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:17.943821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:17.944259 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:17.945124 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:17.945614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:17.946037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:18.078388 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:18.086259 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c09e7e3a-5b77-410c-9239-2bc6634010c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.153736 Sep 09 20:29:18.086851 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 89/176] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:17 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:18.203928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:18.204527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:18.210342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:18.210810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:18.211233 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:18.211903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:18.212344 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:18.212759 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:18.339030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:18.350739 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d1c035c-66f4-499c-afd4-dca33efee599 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1554 microversion: 2.1 time: 0.147735 Sep 09 20:29:18.351398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 88/177] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:18 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:18.573463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:18.574790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:18.581613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:18.582389 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:18.582973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:18.583890 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:18.584552 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:18.584971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:18.742844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:18.753432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf008861-74d4-4d32-9cc5-4c551acb3284 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.184546 Sep 09 20:29:18.754127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 90/178] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:18 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:19.110312 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:19.110935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:19.117740 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:19.118301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:19.118805 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:19.119768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:19.120308 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:19.120797 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:19.264194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:19.272085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6501cde0-ffcd-4e7f-9457-ebf6e5b4f3c9 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.166484 Sep 09 20:29:19.273290 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 89/179] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:19 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:19.373160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:19.375141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:19.383524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:19.384021 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:19.384590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:19.385731 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:19.386329 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:19.386890 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:19.555609 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:19.563842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50274f32-f182-4ee9-b013-4c8d4f75a513 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1554 microversion: 2.1 time: 0.194688 Sep 09 20:29:19.571547 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 91/180] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:19 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:19.776971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:19.778202 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:19.784091 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:19.784861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:19.785516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:19.786466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:19.787092 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:19.787663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:20.017625 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:20.026635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2ba7a08f-3a7c-4178-aa2f-534c5519d17e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.253813 Sep 09 20:29:20.027235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 90/181] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:19 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:20.300236 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:20.302165 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:20.311258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:20.311857 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:20.312390 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:20.313492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:20.314038 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:20.314670 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:20.319959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-af1b41c7-cab6-44eb-84e4-4c985c64ed52 req-0f04d6eb-be1e-4f77-b1a3-35c31f9fd017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3294b2ee-c133-4483-a732-1b10f1130e44", "name": "network-vif-deleted", "tag": "92ac06aa-3b8a-4813-af77-d204e8112bb0"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:20.330766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-af1b41c7-cab6-44eb-84e4-4c985c64ed52 req-0f04d6eb-be1e-4f77-b1a3-35c31f9fd017 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:20.331234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-af1b41c7-cab6-44eb-84e4-4c985c64ed52 req-0f04d6eb-be1e-4f77-b1a3-35c31f9fd017 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:20.331648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-af1b41c7-cab6-44eb-84e4-4c985c64ed52 req-0f04d6eb-be1e-4f77-b1a3-35c31f9fd017 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:20.343104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-af1b41c7-cab6-44eb-84e4-4c985c64ed52 req-0f04d6eb-be1e-4f77-b1a3-35c31f9fd017 service nova] Creating event network-vif-deleted:92ac06aa-3b8a-4813-af77-d204e8112bb0 for instance 3294b2ee-c133-4483-a732-1b10f1130e44 on hv-cinder-84932 Sep 09 20:29:20.352570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-af1b41c7-cab6-44eb-84e4-4c985c64ed52 req-0f04d6eb-be1e-4f77-b1a3-35c31f9fd017 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032183 Sep 09 20:29:20.353236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 91/182] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:29:20.458597 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:20.466966 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c4cc8715-2cb8-4715-989c-7cf13fca0eb0 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.176299 Sep 09 20:29:20.467634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 92/183] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:20 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:20.587982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:20.588684 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:20.596115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:20.596606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:20.597041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:20.597845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:20.598340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:20.598766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:20.701976 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:20.711113 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3857531e-0e6c-49e2-b241-3b407c0b1e4d tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1512 microversion: 2.1 time: 0.127388 Sep 09 20:29:20.712068 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 92/184] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:20 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1512 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:21.050133 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:21.050741 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:21.056530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:21.057004 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:21.057479 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:21.058157 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:21.058609 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:21.059026 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:21.205524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:21.213610 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eef47634-d292-47e8-a12b-b92e32d71505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.167110 Sep 09 20:29:21.214188 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 93/185] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:21 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:21.490870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:21.491488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:21.498307 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:21.498989 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:21.499488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:21.500254 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:21.500932 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:21.501469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:21.644463 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:21.660272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1518426f-82e1-450b-85e8-fced4ac551d6 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.174075 Sep 09 20:29:21.660847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 93/186] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:21 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:21.736364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:21.737637 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:21.745111 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:21.745654 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:21.746584 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:21.747451 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:21.748054 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:21.748615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:21.785835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:21.786227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:21.786660 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:21.787113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lazy-loading 'fault' on Instance uuid 3294b2ee-c133-4483-a732-1b10f1130e44 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:29:21.832359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc41cb3dbe3845d794107f068c70db3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95899c2c318f459bb09bad337d79c1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:21.836195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:21.842118 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f969e7f-21f9-43a1-818f-56701cea19ee tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 200 len: 1351 microversion: 2.1 time: 0.111436 Sep 09 20:29:21.859455 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 94/187] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:21 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 1351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:22.242230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:22.243755 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:22.253394 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:22.254104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:22.254780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:22.255750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:22.256397 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:22.257569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:22.488878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:22.499715 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f144d2fc-b623-41ab-95a8-7034ab1a8f42 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.263397 Sep 09 20:29:22.510417 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 94/188] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:22 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:22.684255 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:22.685143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:22.691740 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:22.692544 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:22.693043 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:22.693846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:22.694572 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:22.695066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:22.864083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:22.864765 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:22.877480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:22.878471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:22.879081 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:22.880580 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:22.881189 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:22.881787 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:22.897058 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:22.910076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] HTTP exception thrown: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Request method failure captured: Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 HTTP/1.1 Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6Hctb7w-t0GsfZkp03keo14U4GWJi8ktcEL7jAm-gOPLToNDWlvCbK7t7GxAz4v1EI_u2kiEKB69MdlHEPnxpxLCIfNzSmaqf1DIrBENZX52X5DN4jjq2WS0KPQRB2UW-JB4wjq_yuwvQkiUZgRji9bQ7FO-1oHBsQEQohmNOG3Z6I Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:29:22.916982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: fc41cb3dbe3845d794107f068c70db3f Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:22.918370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '3294b2ee-c133-4483-a732-1b10f1130e44'} Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:22.919215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:22.920348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:22.922926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5c7121e-87ba-4f21-9145-0512e48be566 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.236684 Sep 09 20:29:22.922926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 95/189] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:22 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:22.924227 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Returning 404 to user: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:22.926172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-00daaeca-93fd-4240-a96c-2067b3d5df3f tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 404 len: 111 microversion: 2.1 time: 0.066103 Sep 09 20:29:22.927430 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 95/190] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:22 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:29:23.061643 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:23.066104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:23.073390 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:23.073939 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:23.075167 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:23.076005 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:23.076432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:23.077082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:23.094775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] HTTP exception thrown: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Request method failure captured: Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44/os-volume_attachments HTTP/1.1 Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6Hctb7w-t0GsfZkp03keo14U4GWJi8ktcEL7jAm-gOPLToNDWlvCbK7t7GxAz4v1EI_u2kiEKB69MdlHEPnxpxLCIfNzSmaqf1DIrBENZX52X5DN4jjq2WS0KPQRB2UW-JB4wjq_yuwvQkiUZgRji9bQ7FO-1oHBsQEQohmNOG3Z6I Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:29:23.099579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: fc41cb3dbe3845d794107f068c70db3f Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:23.100836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'server_id': '3294b2ee-c133-4483-a732-1b10f1130e44'} Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:23.101634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:23.103032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:23.104414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Returning 404 to user: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:23.104414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87bfba19-0e42-4f1e-abb8-3698e351c24c tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046213 Sep 09 20:29:23.104414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 96/191] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:29:23 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:29:23.526883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:23.527634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:23.533700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:23.534360 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:23.534794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:23.535476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:23.536313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:23.536738 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:23.681882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:23.693046 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2cc44b1b-1504-4fe2-b0bb-dfedced03b56 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.167467 Sep 09 20:29:23.693046 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 96/192] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:23 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:23.947850 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:23.948517 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:23.954862 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:23.955337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:23.955774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:23.956460 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:23.956910 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:23.957352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.086396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:24.094967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aab5b986-38b9-4df4-8936-8b67a9223faf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.151334 Sep 09 20:29:24.095602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 97/193] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:23 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:24.338307 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:24.338880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:24.346299 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:24.346870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:24.347491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.348286 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:24.348988 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:24.349677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.375134 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] HTTP exception thrown: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Request method failure captured: Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 HTTP/1.1 Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6Hctb7w-t0GsfZkp03keo14U4GWJi8ktcEL7jAm-gOPLToNDWlvCbK7t7GxAz4v1EI_u2kiEKB69MdlHEPnxpxLCIfNzSmaqf1DIrBENZX52X5DN4jjq2WS0KPQRB2UW-JB4wjq_yuwvQkiUZgRji9bQ7FO-1oHBsQEQohmNOG3Z6I Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:29:24.377324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: fc41cb3dbe3845d794107f068c70db3f Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.378750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '3294b2ee-c133-4483-a732-1b10f1130e44'} Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:24.379576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.380846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.381990 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Returning 404 to user: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:24.383617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e089ca2a-665f-4509-a739-8863238d48f6 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 404 len: 111 microversion: 2.1 time: 0.049298 Sep 09 20:29:24.384272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 97/194] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:29:24 2022] DELETE /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:29:24.393004 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:24.393637 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] [instance: 3294b2ee-c133-4483-a732-1b10f1130e44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:24.400524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:24.401015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:24.401489 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.402830 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:24.403283 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:24.403935 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.419768 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] HTTP exception thrown: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.421641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-7da5c805-a685-4aba-bfaf-b432a3bc40f3 req-f522e23d-c64a-40a6-91a1-7acc79a6447f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1572e9f8-bd24-42ae-9c0e-d0a659792412", "name": "network-vif-plugged", "status": "completed", "tag": "5c2aa298-150f-4083-9c05-cc091fc750a6"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Request method failure captured: Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 HTTP/1.1 Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6Hctb7w-t0GsfZkp03keo14U4GWJi8ktcEL7jAm-gOPLToNDWlvCbK7t7GxAz4v1EI_u2kiEKB69MdlHEPnxpxLCIfNzSmaqf1DIrBENZX52X5DN4jjq2WS0KPQRB2UW-JB4wjq_yuwvQkiUZgRji9bQ7FO-1oHBsQEQohmNOG3Z6I Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:29:24.422570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_95899c2c318f459bb09bad337d79c1a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 95899c2c318f459bb09bad337d79c1a2 Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-DeleteServersTestJSON-2087921599 Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: fc41cb3dbe3845d794107f068c70db3f Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-DeleteServersTestJSON-2087921599-project Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.423725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '3294b2ee-c133-4483-a732-1b10f1130e44'} Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:24.424378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. Sep 09 20:29:24.425486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:24.427516 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] Returning 404 to user: Instance 3294b2ee-c133-4483-a732-1b10f1130e44 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:24.428719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b1b3577-c57a-4c0c-a366-c94d0598dbe5 tempest-DeleteServersTestJSON-2087921599 tempest-DeleteServersTestJSON-2087921599-project] 10.222.0.26 "GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44" status: 404 len: 111 microversion: 2.1 time: 0.039615 Sep 09 20:29:24.431029 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 98/195] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:24 2022] GET /compute/v2.1/servers/3294b2ee-c133-4483-a732-1b10f1130e44 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:29:24.443080 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7da5c805-a685-4aba-bfaf-b432a3bc40f3 req-f522e23d-c64a-40a6-91a1-7acc79a6447f service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:24.443552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7da5c805-a685-4aba-bfaf-b432a3bc40f3 req-f522e23d-c64a-40a6-91a1-7acc79a6447f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:24.444021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-7da5c805-a685-4aba-bfaf-b432a3bc40f3 req-f522e23d-c64a-40a6-91a1-7acc79a6447f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.466631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-7da5c805-a685-4aba-bfaf-b432a3bc40f3 req-f522e23d-c64a-40a6-91a1-7acc79a6447f service nova] Creating event network-vif-plugged:5c2aa298-150f-4083-9c05-cc091fc750a6 for instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 on hv-cinder-84932 Sep 09 20:29:24.476361 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-7da5c805-a685-4aba-bfaf-b432a3bc40f3 req-f522e23d-c64a-40a6-91a1-7acc79a6447f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058381 Sep 09 20:29:24.483437 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 98/196] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:24.713231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:24.714259 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:24.724638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:24.725265 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:24.725774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.726767 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:24.727285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:24.727776 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:24.887422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:24.895242 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5034659e-ebd6-49ba-b8a1-e4f20d8180ba tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.185821 Sep 09 20:29:24.896206 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 99/197] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:24 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:25.119442 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:25.120700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:25.127707 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:25.128360 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:25.128941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:25.129846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:25.130292 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:25.130898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:25.284370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:25.295488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-801481e4-865b-478f-9e95-0d6437ca1080 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.180159 Sep 09 20:29:25.296450 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 99/198] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:25 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:25.920988 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:25.921691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:25.929278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:25.929964 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:25.930692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:25.931552 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:25.932186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:25.932781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:26.080054 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:26.085145 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fbd6ec21-b465-42d3-acaa-d474ee31fd4c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.170774 Sep 09 20:29:26.085754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 100/199] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:25 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:26.319854 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:26.321175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:26.331494 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:26.332326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:26.332968 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:26.334703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:26.335408 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:26.337208 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:26.610050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:26.618163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0421d1a0-0d57-4e57-8dbf-84498645a4b5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1313 microversion: 2.1 time: 0.302058 Sep 09 20:29:26.631569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 100/200] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:26 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:27.108192 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:27.108962 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:27.115825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:27.116308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:27.116735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:27.117466 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:27.117917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:27.118332 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:27.306748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:27.314616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-60b793ba-086a-4403-a574-23f6354455a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.210314 Sep 09 20:29:27.315185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 101/201] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:27 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:27.644748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:27.645601 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:27.653195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:27.653829 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:27.654320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:27.655084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:27.655605 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:27.656092 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:27.862703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:27.872772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2fe6c56e-a581-4c6f-bd50-21916dce7afe tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1497 microversion: 2.1 time: 0.233316 Sep 09 20:29:27.873738 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 101/202] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:27 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:28.338260 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:28.340046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:28.346793 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:28.347365 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:28.348054 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:28.348863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:28.349420 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:28.350051 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:28.516496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:28.532748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ae6ed87b-558a-4e72-b786-1ff49b7dbd89 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.199141 Sep 09 20:29:28.533339 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 102/203] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:28 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:28.586890 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:28.587763 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:28.594596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:28.595338 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:28.596058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:28.596928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:28.597839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:28.598452 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:28.629494 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:29:28.760383 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f3bbfaf8-b128-4764-a36c-560af1c19c7c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 204 len: 0 microversion: 2.1 time: 0.178577 Sep 09 20:29:28.761075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 102/204] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:29:28 2022] DELETE /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:29:28.770586 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:28.771387 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:28.779066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:28.780375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:28.781933 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:28.782893 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:28.783571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:28.784198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:29.143769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:29.160411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e29a996b-6608-4798-8490-e98977de1450 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1503 microversion: 2.1 time: 0.394056 Sep 09 20:29:29.161305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 103/205] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:28 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:29.557798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:29.558827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:29.562086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:29.565469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:29.565979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:29.566385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:29.567060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:29.567503 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:29.567916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:29.738902 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:29.752205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-73a9a008-986d-4f6f-b797-7bd380f5db06 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.196804 Sep 09 20:29:29.752971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 103/206] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:29 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:30.187991 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:30.188518 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:30.210207 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:30.210687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:30.211122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:30.211828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:30.212280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:30.212702 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:30.391343 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:30.399697 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ddf636c-ef5b-4bcf-9c4d-46de7c280ca5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1503 microversion: 2.1 time: 0.218265 Sep 09 20:29:30.401679 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 104/207] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:30 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:30.624092 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5198a708-9c50-4f06-9514-df2353e90c7e tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Action: 'create', calling method: .version_select at 0x7f4834f803a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-186004476", "metadata": {"Type": "work"}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5198a708-9c50-4f06-9514-df2353e90c7e tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Request method failure captured: Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 121 Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6IqgWKWZOassFP3A3Y0r_zvyhw1csBqvrpEgH_8KOry3urZk4grbESM8m0YAUTPynP32l030cwlNky-1QvxMPCrqHGdhqYVf5OfsQbPHKWK7JAojisQkOOzOmGfVoipGn0gkKOWY8KjzlSgb7kP-55cKHa8pynj7a8r02Agic88I58 Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:29:30.634279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 8be4a2a8537749849260ca4b4ce7a4df Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-186004476", "metadata": {"Type": "work"}}} Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: Sep 09 20:29:30.635614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-186004476', 'metadata': {'Type': 'work'}}}} Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:30.636609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 20:29:30.638163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 20:29:30.639560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 20:29:30.639560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.641212 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5198a708-9c50-4f06-9514-df2353e90c7e tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:30.642955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5198a708-9c50-4f06-9514-df2353e90c7e tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.183329 Sep 09 20:29:30.649870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 104/208] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Sep 9 20:29:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:29:30.662019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73c8cc54-e603-48e4-848b-157e6090e545 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Action: 'create', calling method: .version_select at 0x7f4834f808b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2141654096", "metadata": {"Type": "work"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73c8cc54-e603-48e4-848b-157e6090e545 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Request method failure captured: Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 120 Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6IqgWKWZOassFP3A3Y0r_zvyhw1csBqvrpEgH_8KOry3urZk4grbESM8m0YAUTPynP32l030cwlNky-1QvxMPCrqHGdhqYVf5OfsQbPHKWK7JAojisQkOOzOmGfVoipGn0gkKOWY8KjzlSgb7kP-55cKHa8pynj7a8r02Agic88I58 Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:29:30.665337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 8be4a2a8537749849260ca4b4ce7a4df Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2141654096", "metadata": {"Type": "work"}}} Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: Sep 09 20:29:30.666635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2141654096', 'metadata': {'Type': 'work'}}}} Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise error Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi '0' Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:30.667353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 20:29:30.669135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 20:29:30.670195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 20:29:30.670195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.670195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73c8cc54-e603-48e4-848b-157e6090e545 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:30.670195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73c8cc54-e603-48e4-848b-157e6090e545 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016076 Sep 09 20:29:30.673735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 105/209] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Sep 9 20:29:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:29:30.680014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c9d8dad-8715-4a2f-8d94-c23d86bdcfb7 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Action: 'create', calling method: .version_select at 0x7f4834cef670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-913496026", "metadata": {"Type": "work"}}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c9d8dad-8715-4a2f-8d94-c23d86bdcfb7 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Request method failure captured: Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 118 Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6IqgWKWZOassFP3A3Y0r_zvyhw1csBqvrpEgH_8KOry3urZk4grbESM8m0YAUTPynP32l030cwlNky-1QvxMPCrqHGdhqYVf5OfsQbPHKWK7JAojisQkOOzOmGfVoipGn0gkKOWY8KjzlSgb7kP-55cKHa8pynj7a8r02Agic88I58 Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:29:30.685648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 8be4a2a8537749849260ca4b4ce7a4df Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-913496026", "metadata": {"Type": "work"}}} Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: Sep 09 20:29:30.687118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-913496026', 'metadata': {'Type': 'work'}}}} Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise error Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi '' Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:30.687963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 20:29:30.689420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 20:29:30.690648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 20:29:30.690648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.690648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4c9d8dad-8715-4a2f-8d94-c23d86bdcfb7 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:30.690648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4c9d8dad-8715-4a2f-8d94-c23d86bdcfb7 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011998 Sep 09 20:29:30.690648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 105/210] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Sep 9 20:29:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 20:29:30.698821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4adf2330-8d47-42e6-976a-a324529ebe66 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Calling method '.version_select at 0x7f4834d41550>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:30.744055 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4adf2330-8d47-42e6-976a-a324529ebe66 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] HTTP exception thrown: Volume tempest-invalid-1738775179 could not be found. Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4adf2330-8d47-42e6-976a-a324529ebe66 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Request method failure captured: Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1738775179 HTTP/1.1 Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6IqgWKWZOassFP3A3Y0r_zvyhw1csBqvrpEgH_8KOry3urZk4grbESM8m0YAUTPynP32l030cwlNky-1QvxMPCrqHGdhqYVf5OfsQbPHKWK7JAojisQkOOzOmGfVoipGn0gkKOWY8KjzlSgb7kP-55cKHa8pynj7a8r02Agic88I58 Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:29:30.748867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 8be4a2a8537749849260ca4b4ce7a4df Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Volume tempest-invalid-1738775179 could not be found. Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'tempest-invalid-1738775179'} Sep 09 20:29:30.750384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1738775179 could not be found. (HTTP 404) (Request-ID: req-87970aaf-3e03-4ab2-b452-e02a8ca6b9af) Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.751308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 20:29:30.752658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1738775179 could not be found. Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:30.753922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1738775179 could not be found. Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1738775179 could not be found. Sep 09 20:29:30.755344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.758309 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4adf2330-8d47-42e6-976a-a324529ebe66 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Returning 404 to user: Volume tempest-invalid-1738775179 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:30.759370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4adf2330-8d47-42e6-976a-a324529ebe66 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1738775179" status: 404 len: 99 microversion: 2.1 time: 0.065499 Sep 09 20:29:30.760094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 106/211] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Sep 9 20:29:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1738775179 => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 09 20:29:30.775604 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-618ea04b-24bb-46bd-9ef2-c566ac1c7bd1 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007551 Sep 09 20:29:30.776136 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 106/212] 10.222.0.26 () {58 vars in 1140 bytes} [Fri Sep 9 20:29:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 20:29:30.782123 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:30.784604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:30.788033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ac912924-33f8-49cc-8f89-3df627db4294 tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006158 Sep 09 20:29:30.788746 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 107/213] 10.222.0.26 () {58 vars in 1137 bytes} [Fri Sep 9 20:29:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 20:29:30.797410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:30.798809 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ad4df7a-0ffa-4550-91da-f0d6cda19ddc tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Calling method '.version_select at 0x7f48361d5d30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:30.799336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:30.801226 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:30.802762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:30.803496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:30.805128 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:30.847791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4ad4df7a-0ffa-4550-91da-f0d6cda19ddc tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] HTTP exception thrown: Volume 144c338d-d5f4-4a7e-99a8-3f07831f883e could not be found. Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ad4df7a-0ffa-4550-91da-f0d6cda19ddc tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Request method failure captured: Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: DELETE /compute/v2.1/os-volumes/144c338d-d5f4-4a7e-99a8-3f07831f883e HTTP/1.1 Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6IqgWKWZOassFP3A3Y0r_zvyhw1csBqvrpEgH_8KOry3urZk4grbESM8m0YAUTPynP32l030cwlNky-1QvxMPCrqHGdhqYVf5OfsQbPHKWK7JAojisQkOOzOmGfVoipGn0gkKOWY8KjzlSgb7kP-55cKHa8pynj7a8r02Agic88I58 Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:29:30.849892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 8be4a2a8537749849260ca4b4ce7a4df Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Volume 144c338d-d5f4-4a7e-99a8-3f07831f883e could not be found. Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '144c338d-d5f4-4a7e-99a8-3f07831f883e'} Sep 09 20:29:30.851350 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 144c338d-d5f4-4a7e-99a8-3f07831f883e could not be found. (HTTP 404) (Request-ID: req-b78de25d-b02d-408b-8d27-8e9e342ede53) Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.852210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 20:29:30.853588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 144c338d-d5f4-4a7e-99a8-3f07831f883e could not be found. Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 20:29:30.854893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 144c338d-d5f4-4a7e-99a8-3f07831f883e could not be found. Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 144c338d-d5f4-4a7e-99a8-3f07831f883e could not be found. Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.856706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4ad4df7a-0ffa-4550-91da-f0d6cda19ddc tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Returning 404 to user: Volume 144c338d-d5f4-4a7e-99a8-3f07831f883e could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:30.866540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4ad4df7a-0ffa-4550-91da-f0d6cda19ddc tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/144c338d-d5f4-4a7e-99a8-3f07831f883e" status: 404 len: 109 microversion: 2.1 time: 0.059138 Sep 09 20:29:30.867477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 108/214] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:29:30 2022] DELETE /compute/v2.1/os-volumes/144c338d-d5f4-4a7e-99a8-3f07831f883e => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:29:30.876360 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79963d10-0499-4ec0-998c-ce373825ef8a tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Calling method '.version_select at 0x7f4834d078b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:30.933573 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-79963d10-0499-4ec0-998c-ce373825ef8a tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] HTTP exception thrown: Volume 569abf30-44a6-4559-9c79-47f1065d662a could not be found. Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79963d10-0499-4ec0-998c-ce373825ef8a tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Request method failure captured: Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/os-volumes/569abf30-44a6-4559-9c79-47f1065d662a HTTP/1.1 Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6IqgWKWZOassFP3A3Y0r_zvyhw1csBqvrpEgH_8KOry3urZk4grbESM8m0YAUTPynP32l030cwlNky-1QvxMPCrqHGdhqYVf5OfsQbPHKWK7JAojisQkOOzOmGfVoipGn0gkKOWY8KjzlSgb7kP-55cKHa8pynj7a8r02Agic88I58 Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:29:30.935614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e95b9f1ae2142b4b408191b19f1755c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 2e95b9f1ae2142b4b408191b19f1755c Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesNegativeTest-1715954320 Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 8be4a2a8537749849260ca4b4ce7a4df Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-VolumesNegativeTest-1715954320-project Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Volume 569abf30-44a6-4559-9c79-47f1065d662a could not be found. Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '569abf30-44a6-4559-9c79-47f1065d662a'} Sep 09 20:29:30.937115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 569abf30-44a6-4559-9c79-47f1065d662a could not be found. (HTTP 404) (Request-ID: req-85168156-67b4-4f0a-9971-dac97b5921f2) Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.938144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:29:30.939453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 569abf30-44a6-4559-9c79-47f1065d662a could not be found. Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 20:29:30.941179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 569abf30-44a6-4559-9c79-47f1065d662a could not be found. Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 569abf30-44a6-4559-9c79-47f1065d662a could not be found. Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79963d10-0499-4ec0-998c-ce373825ef8a tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] Returning 404 to user: Volume 569abf30-44a6-4559-9c79-47f1065d662a could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79963d10-0499-4ec0-998c-ce373825ef8a tempest-VolumesNegativeTest-1715954320 tempest-VolumesNegativeTest-1715954320-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/569abf30-44a6-4559-9c79-47f1065d662a" status: 404 len: 109 microversion: 2.1 time: 0.068248 Sep 09 20:29:30.951148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 109/215] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:29:30 2022] GET /compute/v2.1/os-volumes/569abf30-44a6-4559-9c79-47f1065d662a => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:29:30.979193 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:30.988344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96451e87-b38a-4e1b-9adb-e18b3e217f32 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.216157 Sep 09 20:29:30.990304 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 107/216] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:30 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:31.203710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f4d13e01-eed2-472c-bb06-76f50996b46b req-df7ab262-0a01-471e-84c3-925682738c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1572e9f8-bd24-42ae-9c0e-d0a659792412", "name": "network-vif-deleted", "tag": "5c2aa298-150f-4083-9c05-cc091fc750a6"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:31.214941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f4d13e01-eed2-472c-bb06-76f50996b46b req-df7ab262-0a01-471e-84c3-925682738c3a service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:31.215789 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f4d13e01-eed2-472c-bb06-76f50996b46b req-df7ab262-0a01-471e-84c3-925682738c3a service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:31.216211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f4d13e01-eed2-472c-bb06-76f50996b46b req-df7ab262-0a01-471e-84c3-925682738c3a service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:31.228884 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:31.231695 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f4d13e01-eed2-472c-bb06-76f50996b46b req-df7ab262-0a01-471e-84c3-925682738c3a service nova] Creating event network-vif-deleted:5c2aa298-150f-4083-9c05-cc091fc750a6 for instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 on hv-cinder-84932 Sep 09 20:29:31.237868 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f4d13e01-eed2-472c-bb06-76f50996b46b req-df7ab262-0a01-471e-84c3-925682738c3a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037671 Sep 09 20:29:31.239148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 110/217] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:31.429036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:31.429842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:31.437697 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:31.438704 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:31.439303 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:31.440394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:31.441017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:31.441804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:31.479015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:31.479520 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:31.480614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:31.481263 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lazy-loading 'fault' on Instance uuid 1572e9f8-bd24-42ae-9c0e-d0a659792412 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:29:31.524806 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:31.535292 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3620043c-8e52-4c91-8034-e865228a0a35 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 200 len: 1303 microversion: 2.1 time: 0.113558 Sep 09 20:29:31.536501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 108/218] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:31 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:32.019484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:32.020943 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:32.030259 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:32.030940 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:32.031446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:32.032220 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:32.032738 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:32.033398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:32.227273 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:32.235768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-403a5f33-0175-4f60-8d55-a5e356aec3a3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.227319 Sep 09 20:29:32.236515 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 111/219] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:32 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:32.559842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:32.561604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 1572e9f8-bd24-42ae-9c0e-d0a659792412] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:32.574285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:32.575720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:32.576705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:32.578405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:32.579328 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:32.580036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:32.602297 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] HTTP exception thrown: Instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 could not be found. Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Request method failure captured: Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 HTTP/1.1 Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6IFyYRusVvA5YgRK6KlGL369AB3M1q-20j2EAbRBQ0kXNI5P4Yk6nONgx6Ywf7ox1D-eBgYwnrPzsD37g5OcVedDOqnM12nQjI-FTbJCmOG-s8P5dkKQIy1Ah8kI2bqvp4p2UqWjzDtsuqvwFi_NKLEQQzMXRHImgNz0dFF1Eh4hME Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 32c862d7b7b242f699139ac0821867a8 Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesActionsTest-534535108 Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:29:32.605071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/32c862d7b7b242f699139ac0821867a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/32c862d7b7b242f699139ac0821867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/32c862d7b7b242f699139ac0821867a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_32c862d7b7b242f699139ac0821867a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesActionsTest-534535108 Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 32c862d7b7b242f699139ac0821867a8 Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesActionsTest-534535108 Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesActionsTest-534535108-project Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 892bbd02129b417c987f4d429e21a833 Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesActionsTest-534535108-project Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 could not be found. Sep 09 20:29:32.606294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '1572e9f8-bd24-42ae-9c0e-d0a659792412'} Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 could not be found. Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:29:32.607360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 could not be found. Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 could not be found. Sep 09 20:29:32.608437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:29:32.609438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Returning 404 to user: Instance 1572e9f8-bd24-42ae-9c0e-d0a659792412 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:29:32.609438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51b94cee-b869-42cc-890e-5320fd101eb5 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412" status: 404 len: 111 microversion: 2.1 time: 0.052674 Sep 09 20:29:32.611534 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 109/220] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:32 2022] GET /compute/v2.1/servers/1572e9f8-bd24-42ae-9c0e-d0a659792412 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:29:32.764964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1450301966", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "networks": [{"uuid": "2cbef6b9-0698-42fe-962c-df7eb81f10bf"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:32.834573 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] validate_networks() for [('2cbef6b9-0698-42fe-962c-df7eb81f10bf', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:29:33.261149 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:33.261789 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:33.273457 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:33.275444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:33.276517 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:33.278948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:33.281053 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:33.282529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:33.288327 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:29:33.288965 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:29:33.289554 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:29:33.289994 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:29:33.290400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:29:33.305565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:33.306369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:33.306708 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:33.307700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:33.308281 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:33.308715 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:33.337378 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Getting quotas for project 32c862d7b7b242f699139ac0821867a8. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:29:33.343717 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Getting quotas for user 892bbd02129b417c987f4d429e21a833 and project 32c862d7b7b242f699139ac0821867a8. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:29:33.358790 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:29:33.362176 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:29:33.446169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d7eaa5fe-c9b6-4f77-b670-615916a9a2a1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685535 Sep 09 20:29:33.447240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 112/221] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:29:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 20:29:33.466132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba6648eb-7e05-4878-bcfc-673cea6ad71f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:33.467108 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ba6648eb-7e05-4878-bcfc-673cea6ad71f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:33.482855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:33.495735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-049b154c-f928-457a-8309-fe2579648d3e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.238351 Sep 09 20:29:33.496500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 110/222] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:33 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:33.545105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ba6648eb-7e05-4878-bcfc-673cea6ad71f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:33.554572 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba6648eb-7e05-4878-bcfc-673cea6ad71f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1214 microversion: 2.1 time: 0.093958 Sep 09 20:29:33.555354 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 113/223] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:33 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:34.520598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:34.521313 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:34.528003 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:34.528550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:34.529154 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:34.529871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:34.530328 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:34.530745 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:34.580211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:34.581681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:34.589297 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:34.590012 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:34.590587 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:34.591462 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:34.591927 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:34.592598 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:34.676971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:34.693207 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78626911-b9c2-471d-9a7a-ee5a8ff7395c tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1218 microversion: 2.1 time: 0.118035 Sep 09 20:29:34.703693 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 114/224] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:34 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:34.722510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:34.732833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc22dec1-e2fa-4fd4-ae6c-3e4b33e11361 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.216005 Sep 09 20:29:34.734936 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 111/225] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:34 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:35.725867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:35.726558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:35.733229 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:35.733801 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:35.734298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:35.735041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:35.735555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:35.736039 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:35.756547 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:35.757348 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:35.768241 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:35.770885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:35.771500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:35.772411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:35.772874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:35.784217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:35.806896 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:35.815422 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8284c719-99b8-4a15-afa4-ad6075634c3d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1266 microversion: 2.1 time: 0.093634 Sep 09 20:29:35.815973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 115/226] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:35 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:35.933574 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:35.941168 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73f2c268-b18f-4f29-9297-45a15f9b01b2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.189106 Sep 09 20:29:35.941759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 112/227] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:35 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:36.838554 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:36.839185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:36.844964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:36.845636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:36.846059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:36.846737 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:36.847178 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:36.847590 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:36.908396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:36.915876 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b22418b0-5bf9-458c-af91-af0fb3ce8a1b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1266 microversion: 2.1 time: 0.081115 Sep 09 20:29:36.916429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 116/228] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:36 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:36.963575 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:36.964213 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:36.970609 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:36.971092 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:36.971525 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:36.972211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:36.972665 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:36.973082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:37.102182 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:37.110636 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-08806188-d4e8-4684-bf6f-a1065cdeb0f5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.150899 Sep 09 20:29:37.111370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 113/229] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:36 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:37.938713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:37.939251 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:37.945099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:37.945600 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:37.946033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:37.946704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:37.947143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:37.947553 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:38.012473 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:38.020032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-779de92e-fbde-47d7-99dc-83d045300692 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1266 microversion: 2.1 time: 0.085361 Sep 09 20:29:38.020597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 117/230] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:37 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:38.134411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:38.135056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:38.142239 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:38.142746 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:38.143178 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:38.143859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:38.144310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:38.144723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:38.270056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:38.277635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dc498d6f-bace-462d-801f-064a149920d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1523 microversion: 2.1 time: 0.147540 Sep 09 20:29:38.278195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 114/231] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:38 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:39.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:39.044698 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:39.052278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:39.052761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:39.053189 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:39.054067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:39.054663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:39.055252 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:39.249049 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:39.257933 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b29a5cef-f61a-4573-b9a3-33937dcffa6d tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.217860 Sep 09 20:29:39.259060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 118/232] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:39 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:39.300846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:39.301814 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:39.308248 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=72 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:39.310053 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:39.310678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:39.311211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:39.312001 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:39.312551 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:39.313090 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:39.319366 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:39.477872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:39.490872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-41c904db-05d3-4f60-b755-f64a356d62ae tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1503 microversion: 2.1 time: 0.194384 Sep 09 20:29:39.491834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 115/233] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:39 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:39.517040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:39.518345 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:39.524501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:39.524989 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:39.525451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:39.526565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:39.527344 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:39.527930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:39.732571 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:39.742766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-26f76fa2-8119-470a-bcda-625bc416a07f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1516 microversion: 2.1 time: 0.230142 Sep 09 20:29:39.743352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 119/234] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:39 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:40.180024 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-070e5680-2801-4e8b-ae6a-b3aed615e3bb req-8ffa8230-01cd-49b9-818e-761bc0d20e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e38a01-a7a2-452c-9a08-fe4bcc2d816d", "tag": "7157c67a-6889-4bef-89d3-a5b69b26bed3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:40.197479 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-070e5680-2801-4e8b-ae6a-b3aed615e3bb req-8ffa8230-01cd-49b9-818e-761bc0d20e79 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:40.198426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-070e5680-2801-4e8b-ae6a-b3aed615e3bb req-8ffa8230-01cd-49b9-818e-761bc0d20e79 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:40.198952 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-070e5680-2801-4e8b-ae6a-b3aed615e3bb req-8ffa8230-01cd-49b9-818e-761bc0d20e79 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:40.216283 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-070e5680-2801-4e8b-ae6a-b3aed615e3bb req-8ffa8230-01cd-49b9-818e-761bc0d20e79 service nova] Creating event network-changed:7157c67a-6889-4bef-89d3-a5b69b26bed3 for instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d on hv-cinder-84932 Sep 09 20:29:40.224464 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-070e5680-2801-4e8b-ae6a-b3aed615e3bb req-8ffa8230-01cd-49b9-818e-761bc0d20e79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050062 Sep 09 20:29:40.225374 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 116/235] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:40.282027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:40.282731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:40.288781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:40.289382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:40.289811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:40.290498 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:40.290950 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:40.291366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:40.429265 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:40.438558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1cbf79cc-7457-4a0e-89b7-4517323f3aae tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.160339 Sep 09 20:29:40.439504 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 120/236] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:40 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:41.255741 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:41.258248 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:41.265470 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:41.265954 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:41.266409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:41.267276 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:41.267872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:41.268293 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:41.293119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lazy-loading 'flavor' on Instance uuid fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:29:41.412279 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-feef0885-a61a-4712-9516-c66a4be98ea4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5/action" status: 200 len: 32 microversion: 2.1 time: 0.161555 Sep 09 20:29:41.412910 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 117/237] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:29:41 2022] POST /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:29:41.422281 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:41.422887 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:41.428951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:41.429465 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:41.429898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:41.430586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:41.431037 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:41.431464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:41.461563 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:41.462729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:41.470347 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:41.470993 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:41.471556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:41.472342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:41.472872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:41.473342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:41.618947 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:41.627793 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-32338d45-aed2-4e3d-a967-33109ad82803 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.209233 Sep 09 20:29:41.641792 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 121/238] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:41 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:41.652096 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:41.665432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5e7f5664-e3a8-49ab-a780-0adebd35a641 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.208131 Sep 09 20:29:41.666106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 118/239] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:41 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:42.532364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:42.533491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:42.555721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:42.556240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:42.556805 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:42.557600 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:42.558062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:42.558472 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:42.585862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e9da4bbf-986d-4990-af63-27de8616fe8e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/ips" status: 200 len: 145 microversion: 2.1 time: 0.057288 Sep 09 20:29:42.586450 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 122/240] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:29:42 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/ips => generated 145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:42.652697 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:42.653858 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:42.665935 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:42.672082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:42.679160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:42.679992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:42.680328 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:42.681487 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:42.687954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:42.688591 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:42.696941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:42.697477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:42.697919 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:42.698623 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:42.699078 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:42.699502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:42.913135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:42.921967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa2fa93b-14b9-4bc9-978f-325c8d9db5bd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.273722 Sep 09 20:29:42.922996 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 119/241] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:42 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:42.945891 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:42.955067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d705ff4-cadd-4145-aab4-15a767c42440 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.270674 Sep 09 20:29:42.955830 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 123/242] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:42 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:43.945535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:43.946148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:43.954907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:43.955045 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:43.955385 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:43.956086 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:43.957095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:43.957095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:43.978381 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:43.979136 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:43.981937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:43.982607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=8 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:43.995813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:43.996309 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:43.996746 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:43.997467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:43.997920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:43.998395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:44.243636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:44.247209 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:44.251746 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43d60d78-74d4-43c8-bea2-74949a916411 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.277115 Sep 09 20:29:44.252326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 124/243] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:43 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:44.257055 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bcfdad54-d48a-4bea-baa5-c2fcf8103e34 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.315508 Sep 09 20:29:44.258139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 120/244] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:43 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:45.281981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:45.283057 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:45.284230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:45.285056 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:45.292327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:45.292828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:45.293333 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:45.294174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:45.294635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:45.295060 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:45.300091 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:45.300855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:45.301579 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:45.302651 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:45.303316 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:45.304781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:45.540306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:45.551718 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:45.553100 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0277d6fc-e2d1-4c3f-9b9a-f315f38ff8c2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.281753 Sep 09 20:29:45.570453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 125/245] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:45 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:45.575133 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-731f3b0f-7c0f-48e5-bb2d-c309790bc9d3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.298763 Sep 09 20:29:45.576230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 121/246] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:45 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:45.882149 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e368782c-e909-4b29-9083-ba80b74d5645"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:45.887049 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:45.894867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:45.895358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:45.895798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:45.896621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:45.897547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:45.897978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:46.257815 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-261220a0-6a5b-44e5-ab01-d45aa7a664d6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380490 Sep 09 20:29:46.259275 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 126/247] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:29:45 2022] POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:29:46.466692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-3091c4a3-5268-4377-b42d-1beed7701816 req-d7acdb0b-27bc-443e-9271-fb88cb14b5bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e38a01-a7a2-452c-9a08-fe4bcc2d816d", "name": "network-vif-plugged", "status": "completed", "tag": "7157c67a-6889-4bef-89d3-a5b69b26bed3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:46.484291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3091c4a3-5268-4377-b42d-1beed7701816 req-d7acdb0b-27bc-443e-9271-fb88cb14b5bc service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:46.485202 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3091c4a3-5268-4377-b42d-1beed7701816 req-d7acdb0b-27bc-443e-9271-fb88cb14b5bc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:46.486019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-3091c4a3-5268-4377-b42d-1beed7701816 req-d7acdb0b-27bc-443e-9271-fb88cb14b5bc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:46.504734 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-3091c4a3-5268-4377-b42d-1beed7701816 req-d7acdb0b-27bc-443e-9271-fb88cb14b5bc service nova] Creating event network-vif-plugged:7157c67a-6889-4bef-89d3-a5b69b26bed3 for instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d on hv-cinder-84932 Sep 09 20:29:46.520766 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-3091c4a3-5268-4377-b42d-1beed7701816 req-d7acdb0b-27bc-443e-9271-fb88cb14b5bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059238 Sep 09 20:29:46.521846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 122/248] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:46.577788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:46.580258 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:46.601811 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:46.602672 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:46.610844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:46.611377 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:46.612072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:46.612745 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:46.613359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:46.613961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:46.616892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:46.620943 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:46.621675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:46.622564 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:46.624413 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:46.625750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:46.859229 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:46.870529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-119dec24-64ee-4e6a-b7fd-6e2fa99fb5ea tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.273473 Sep 09 20:29:46.876153 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 123/249] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:46 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:46.891145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:46.904497 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4d9d922c-0fe7-4734-bfc3-92ce28ca2d86 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.331943 Sep 09 20:29:46.906084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 127/250] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:46 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:47.902465 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:47.903039 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:47.909414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:47.909889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:47.910317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:47.910996 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:47.911442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:47.911859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:47.929578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:47.930185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:47.937457 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:47.938187 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:47.938617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:47.939485 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:47.939934 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:47.940356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:47.945145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:48.146117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:48.155188 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:48.164018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eefa9796-e480-499a-a24a-7c5861a73e96 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1314 microversion: 2.1 time: 0.238970 Sep 09 20:29:48.177540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c82a5117-f3cf-4c4b-a780-3bfb4af000da tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.271343 Sep 09 20:29:48.177540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 124/251] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:47 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:48.178342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 128/252] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:47 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:49.189374 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:49.189906 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:49.196422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:49.196904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:49.197371 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:49.198087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:49.198544 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:49.198966 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:49.199928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:49.200536 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:49.206828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:49.207307 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:49.207736 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:49.208418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:49.208867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:49.209318 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:49.394860 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:49.397655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:49.403660 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ee8dd4c-4b35-4765-a692-157a1cc046a4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.207482 Sep 09 20:29:49.404230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 129/253] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:49 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:49.408191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ef961f98-5bd9-4d93-8210-b9e8b4fab6db tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1497 microversion: 2.1 time: 0.222790 Sep 09 20:29:49.408916 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 125/254] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:49 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:50.427547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:50.428085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:50.434477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:50.434946 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:50.435370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:50.436040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:50.436484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:50.436900 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:50.700898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:50.708700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b6cc28d7-bc44-4e1c-abe7-d8dfaaf9ae28 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.285079 Sep 09 20:29:50.709288 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 130/255] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:50 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:51.732403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:51.733035 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:51.740565 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:51.741075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:51.741543 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:51.742231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:51.742701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:51.743146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:51.869590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:51.877232 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a3362ffe-1472-4075-87e5-722bef3a6fe3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.149320 Sep 09 20:29:51.877816 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 126/256] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:51 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:52.378737 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:52.379313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:52.386743 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:52.387216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:52.387645 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:52.388344 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:52.388791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:52.389205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:52.417133 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:29:52.497174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0a2a7313-6513-4114-a889-a6747288edd2 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 204 len: 0 microversion: 2.1 time: 0.122358 Sep 09 20:29:52.498126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 131/257] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:29:52 2022] DELETE /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:29:52.506631 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:52.507452 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:52.514277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:52.514761 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:52.515184 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:52.515868 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:52.516312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:52.516738 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:52.650230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:52.661852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1f78cfa4-61af-48cd-984d-7428b04f7613 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1503 microversion: 2.1 time: 0.159566 Sep 09 20:29:52.662701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 127/258] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:52 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:52.903064 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:52.903681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:52.909521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:52.909996 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:52.910423 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:52.911088 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:52.911532 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:52.911945 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:53.043469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:53.051087 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-591f9a72-df26-4ee3-b3dd-dd702b1b8b51 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.152308 Sep 09 20:29:53.051653 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 132/259] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:52 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:53.684334 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:53.684935 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:53.691395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:53.691744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:53.692173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:53.692850 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:53.693321 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:53.693736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:53.825506 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:53.833085 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-497cae59-0a13-4009-b26d-21844933f45b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1503 microversion: 2.1 time: 0.153194 Sep 09 20:29:53.833677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 128/260] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:53 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:54.072753 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:54.073596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:54.079961 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:54.080437 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:54.080863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:54.081575 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:54.082022 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:54.082438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:54.212358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:54.220428 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-90870993-ff1d-401d-8e17-be07c8d1d1c6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.151402 Sep 09 20:29:54.220997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 133/261] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:54 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:54.856525 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:54.857133 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:54.863235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:54.863713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:54.864146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:54.865089 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:54.865641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:54.866062 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:54.989440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:54.997268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f235e0b8-7d02-4a38-b6f2-1f57287dda0f tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1503 microversion: 2.1 time: 0.145130 Sep 09 20:29:54.998073 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 129/262] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:54 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1503 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:55.244058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:55.244935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:55.252721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:55.253201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:55.253659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:55.254436 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:55.254886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:55.255329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:55.386720 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:55.394508 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e36908f-2a5c-4405-8b13-cad44b90a158 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.154873 Sep 09 20:29:55.395063 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 134/263] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:55 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:56.019820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:56.020432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:56.026872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:56.027364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:56.027788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:56.028481 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:56.028925 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:56.029383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:56.165758 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:56.173426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32ebac45-f281-4a22-86dc-621df439af0a tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1503 microversion: 2.1 time: 0.157378 Sep 09 20:29:56.173998 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 130/264] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:56 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:56.417900 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:56.418613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:56.426084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:56.426578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:56.426998 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:56.427676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:56.428280 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:56.429040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:56.633264 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:56.642405 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7829028-bc79-416a-b6bb-268f104ef8be tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.228815 Sep 09 20:29:56.643262 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 135/265] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:56 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:57.198820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:57.199612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:57.207336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:57.207819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:57.208252 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:57.208949 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:57.209428 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:57.210019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:57.215804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:57.513511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:57.521422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3bb9ce6-7b4b-4b28-8a21-ef36f2e29be1 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1503 microversion: 2.1 time: 0.327580 Sep 09 20:29:57.533585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 131/266] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:57 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:57.673504 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:57.673504 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:57.680159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:57.680665 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:57.681342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:57.682192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:57.683008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:57.683915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:57.860952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:57.872405 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9589c049-b874-46aa-a5a5-a655102575ee tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.209710 Sep 09 20:29:57.873616 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 136/267] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:57 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:58.206416 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8dfcae8b-2997-4012-add9-e5cfe69a6a90 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:58.216729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dfcae8b-2997-4012-add9-e5cfe69a6a90 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.217685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dfcae8b-2997-4012-add9-e5cfe69a6a90 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.218386 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8dfcae8b-2997-4012-add9-e5cfe69a6a90 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.307637 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8dfcae8b-2997-4012-add9-e5cfe69a6a90 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 20:29:58.355080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8dfcae8b-2997-4012-add9-e5cfe69a6a90 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action" status: 202 len: 0 microversion: 2.1 time: 0.154853 Sep 09 20:29:58.355737 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 132/268] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:29:58 2022] POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:29:58.364165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:58.365076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:58.372227 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.372809 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.373283 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.374001 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.374834 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.375303 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.546801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:58.547713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:58.554193 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.554889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.555517 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.556407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.557059 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.557671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.560799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:58.571402 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11739b7a-ae86-42b8-9f66-5ee053ee0daa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.210988 Sep 09 20:29:58.573969 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 137/269] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:58 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:58.744396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:58.752594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be15827c-1a12-4874-9d71-7bc8671cf006 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1503 microversion: 2.1 time: 0.209921 Sep 09 20:29:58.753841 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 133/270] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:58 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:29:58.894817 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f53bbbac-b9b4-4b5d-b442-ddea2e4bf812 req-af224aab-afea-40c9-8607-4d245491ab11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e38a01-a7a2-452c-9a08-fe4bcc2d816d", "name": "network-vif-deleted", "tag": "7157c67a-6889-4bef-89d3-a5b69b26bed3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:29:58.907768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f53bbbac-b9b4-4b5d-b442-ddea2e4bf812 req-af224aab-afea-40c9-8607-4d245491ab11 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.908000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:58.908436 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:58.908786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f53bbbac-b9b4-4b5d-b442-ddea2e4bf812 req-af224aab-afea-40c9-8607-4d245491ab11 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.909455 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f53bbbac-b9b4-4b5d-b442-ddea2e4bf812 req-af224aab-afea-40c9-8607-4d245491ab11 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.919095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.922184 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.922761 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.923573 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.923849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f53bbbac-b9b4-4b5d-b442-ddea2e4bf812 req-af224aab-afea-40c9-8607-4d245491ab11 service nova] Creating event network-vif-deleted:7157c67a-6889-4bef-89d3-a5b69b26bed3 for instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d on hv-cinder-84932 Sep 09 20:29:58.924178 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.924814 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.931657 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f53bbbac-b9b4-4b5d-b442-ddea2e4bf812 req-af224aab-afea-40c9-8607-4d245491ab11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039261 Sep 09 20:29:58.932802 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 138/271] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:29:58.938903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:58.939849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:58.948620 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.949342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.949975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.951849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:58.952464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:58.953537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:58.981526 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dcca0a6c-f034-47bd-b0d1-f225a7ca9a0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/ips" status: 200 len: 153 microversion: 2.20 time: 0.046954 Sep 09 20:29:58.982415 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 139/272] 10.222.0.26 () {60 vars in 1289 bytes} [Fri Sep 9 20:29:58 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/ips => generated 153 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:29:59.095789 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:59.109515 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-133530ac-0167-4634-b2c8-f39012686cd6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.214300 Sep 09 20:29:59.122444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 134/273] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:58 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:59.600375 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:59.601560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:59.603710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:29:59.609116 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:59.609656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:59.610333 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:59.611028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:59.611636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:59.612062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:59.753335 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:59.764991 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8f55a37c-1f2d-4f0d-aec6-39687140754c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.168476 Sep 09 20:29:59.765662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 140/274] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:59 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:29:59.787213 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:29:59.787818 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:29:59.795359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:59.796033 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:59.796702 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:59.797471 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:59.797917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:59.798499 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:59.830066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:29:59.830575 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:29:59.831004 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:29:59.831667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lazy-loading 'fault' on Instance uuid 46e38a01-a7a2-452c-9a08-fe4bcc2d816d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:29:59.875621 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:29:59.886488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9ab3f5bb-539a-459d-8a41-0c9e96d32dbf tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1304 microversion: 2.1 time: 0.102998 Sep 09 20:29:59.887264 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 135/275] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:29:59 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:00.137300 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:00.138486 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:00.145270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.145788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.146213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.146898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.147342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.147766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.315674 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:00.319887 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-04e3c2ce-95ee-48e9-ab67-82ee1a045ec0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.186492 Sep 09 20:30:00.320450 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 141/276] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:00 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:00.790776 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:00.792723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:00.799623 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.800119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.800553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.801280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.801733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.802342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.910201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:00.910926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:00.918111 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.918434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.918972 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.919729 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.920271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.920758 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.958292 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:00.962290 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.962766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.963696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.964132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lazy-loading 'fault' on Instance uuid 46e38a01-a7a2-452c-9a08-fe4bcc2d816d {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:30:00.968095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4532bec-5fc5-40fa-ab95-78244a0e3188 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.181385 Sep 09 20:30:00.968662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 136/277] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:00 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:00.974332 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:00.974859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:00.981197 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.981844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.982274 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:00.982968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:00.983417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:00.983841 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:01.008336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:01.009060 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lazy-loading 'flavor' on Instance uuid abe125d2-51c7-4732-aa2a-90ab2d85d05f {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:30:01.017581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d86de964-035e-4296-963f-44f55ccdf4ba tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1304 microversion: 2.1 time: 0.111146 Sep 09 20:30:01.018145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 142/278] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:00 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:01.233155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d0347be5-19b0-480a-9e39-30014f74b939 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/action" status: 202 len: 0 microversion: 2.20 time: 0.263103 Sep 09 20:30:01.233871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 137/279] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Sep 9 20:30:00 2022] POST /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:30:01.242447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:01.243088 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:01.249543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:01.250024 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:01.250455 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:01.251143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:01.251593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:01.252013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:01.345931 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:01.347551 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:01.354508 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:01.355321 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:01.355938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:01.356840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:01.357559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:01.357997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:01.385751 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:01.390268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:01.396556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:01.398790 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:01.399925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b696c8f6-ec27-4d46-9649-688bbf10ab02 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.161598 Sep 09 20:30:01.400677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 143/280] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:01 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:01.510414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:01.518418 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e6a0d74b-3da8-4277-bd51-72cd092160a7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.177542 Sep 09 20:30:01.518985 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 138/281] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:01 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:01.996439 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:01.997312 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:02.004360 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.004833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.005283 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.005965 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.006411 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.006830 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.039899 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:02.040625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:02.047754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.048232 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.048688 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.049581 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.050035 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.050453 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.082999 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.083396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.083824 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.084267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lazy-loading 'fault' on Instance uuid 46e38a01-a7a2-452c-9a08-fe4bcc2d816d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:30:02.142134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:02.153362 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6f8fb624-d5e5-47d1-8792-4696e4651c82 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1304 microversion: 2.1 time: 0.117205 Sep 09 20:30:02.174070 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 139/282] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:02 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:02.234689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:02.248681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-17b459d5-4e38-455e-a41c-45e3156e21ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.256584 Sep 09 20:30:02.250209 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 144/283] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:01 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:02.425801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:02.426335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:02.432671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.433146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.433616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.434311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.434759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.435177 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.544511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:02.547898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:02.570318 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.573635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.576502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.579172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:02.582110 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:02.582993 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:02.666879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:02.695740 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:02.706287 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:02.710127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bdafb6de-7755-4489-90e4-ba060733f669 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.285690 Sep 09 20:30:02.715224 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 140/284] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:02 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:02.938663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:02.957093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d3c03c17-e3cc-4d26-a3e5-9c52398743b8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.419867 Sep 09 20:30:02.958432 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 145/285] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:02 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:03.176522 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:03.177135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:03.187262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.205598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:03.205598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:03.205598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.205598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:03.206008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:03.254441 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.255942 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:03.256753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:03.262239 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lazy-loading 'fault' on Instance uuid 46e38a01-a7a2-452c-9a08-fe4bcc2d816d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:30:03.274258 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:03.274971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:03.287055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.287695 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:03.288195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:03.289115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.289842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:03.290500 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:03.346773 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '892bbd02129b417c987f4d429e21a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32c862d7b7b242f699139ac0821867a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:03.356477 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5b8037b-0be2-4b36-a137-fd8fd3ded276 tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 200 len: 1304 microversion: 2.1 time: 0.183859 Sep 09 20:30:03.357106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 141/286] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:03 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:03.491927 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:03.500419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2fdbdf43-d6e2-482a-a2a5-c60f3bf7e269 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.231886 Sep 09 20:30:03.501004 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 146/287] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:03 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:03.740989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:03.741731 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:03.748631 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.749285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:03.749848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:03.750650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.751324 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:03.751753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:03.983264 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:03.984036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:03.999325 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:03.999920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.000469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.001322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.002251 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.002525 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.289580 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:04.306205 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:04.309929 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:04.311405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02f023e3-566c-48c1-9ef2-bcb51a0ed43a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.574966 Sep 09 20:30:04.311723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 142/288] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:03 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:04.336812 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:04.348044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-05a73ff5-7a50-43e2-a2f6-928711b4fc66 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1502 microversion: 2.1 time: 0.369021 Sep 09 20:30:04.358777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 147/289] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:03 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1502 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:04.376784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "093c3817-87c8-41e2-b3bb-fac2213343ba"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:04.383247 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:04.384038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] [instance: 46e38a01-a7a2-452c-9a08-fe4bcc2d816d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:04.387984 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:04.397628 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.398117 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.398547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.402246 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.404026 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.404681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.405304 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.409373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.410020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.410896 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.411505 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.412095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.428705 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] HTTP exception thrown: Instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d could not be found. Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Request method failure captured: Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d HTTP/1.1 Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6IFyYRusVvA5YgRK6KlGL369AB3M1q-20j2EAbRBQ0kXNI5P4Yk6nONgx6Ywf7ox1D-eBgYwnrPzsD37g5OcVedDOqnM12nQjI-FTbJCmOG-s8P5dkKQIy1Ah8kI2bqvp4p2UqWjzDtsuqvwFi_NKLEQQzMXRHImgNz0dFF1Eh4hME Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 32c862d7b7b242f699139ac0821867a8 Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesActionsTest-534535108 Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:30:04.430446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/32c862d7b7b242f699139ac0821867a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/32c862d7b7b242f699139ac0821867a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/32c862d7b7b242f699139ac0821867a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_32c862d7b7b242f699139ac0821867a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-VolumesActionsTest-534535108 Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 32c862d7b7b242f699139ac0821867a8 Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesActionsTest-534535108 Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-VolumesActionsTest-534535108-project Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 892bbd02129b417c987f4d429e21a833 Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-VolumesActionsTest-534535108-project Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d could not be found. Sep 09 20:30:04.432373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '46e38a01-a7a2-452c-9a08-fe4bcc2d816d'} Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d could not be found. Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:30:04.433104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d could not be found. Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d could not be found. Sep 09 20:30:04.434322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.435577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] Returning 404 to user: Instance 46e38a01-a7a2-452c-9a08-fe4bcc2d816d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:30:04.435577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-99b52856-ebd8-42b6-b6ef-e5dd28bd045b tempest-VolumesActionsTest-534535108 tempest-VolumesActionsTest-534535108-project] 10.222.0.26 "GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d" status: 404 len: 111 microversion: 2.1 time: 0.055852 Sep 09 20:30:04.435577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 148/290] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:04 2022] GET /compute/v2.1/servers/46e38a01-a7a2-452c-9a08-fe4bcc2d816d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:30:04.490723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] HTTP exception thrown: Cannot 'attach_volume' instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 while it is in vm_state rescued Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Request method failure captured: Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: POST /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5/os-volume_attachments HTTP/1.1 Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 74 Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HiCOFZyuZ-ZTyWWLYgPe2Fl0u1RCs41Ue4gboYqbaAz9wKDooOGtWDJ0T5oZUyuL_oKMxGPSr25tvsKPqIJRJmt1_AcZ0WBVpWGm669vz3jv4XQdsbKybbhUvmaawpaQ9K7lypMpIGWpy2q2X_uBd_LiiE2b9xoECuB-UE7EFF45M Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:30:04.494874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f07defd609684351b4b7d0d110212a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: a95746e7a84541199b43138b1a348386 Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {"volumeAttachment": {"volumeId": "093c3817-87c8-41e2-b3bb-fac2213343ba"}} Sep 09 20:30:04.497439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Cannot 'attach_volume' instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 while it is in vm_state rescued Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'server_id': 'fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5', 'body': {'volumeAttachment': {'volumeId': '093c3817-87c8-41e2-b3bb-fac2213343ba'}}} Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:30:04.499624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 while it is in vm_state rescued Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:30:04.505790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:30:04.508225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:30:04.508225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:30:04.508225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 while it is in vm_state rescued Sep 09 20:30:04.508225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:30:04.508225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Returning 409 to user: Cannot 'attach_volume' instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 while it is in vm_state rescued {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:30:04.508225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-022b8188-c09f-4642-8815-105a2e7c4019 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.124093 Sep 09 20:30:04.508225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 143/291] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:30:04 2022] POST /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5/os-volume_attachments => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 20:30:04.511650 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:04.511650 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:04.524738 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.525397 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.526101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.526814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.527274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.527702 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.534969 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:04.536127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:04.548301 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.551730 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.552457 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.554621 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.556084 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.558697 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.574406 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:04.640171 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28d8c881-39ad-4c8d-8a63-4ce70772dab2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5/action" status: 202 len: 0 microversion: 2.1 time: 0.135564 Sep 09 20:30:04.644221 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 149/292] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:30:04 2022] POST /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:30:04.656108 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:04.657037 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:04.677180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.684987 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.685493 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.686248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:04.686712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:04.700642 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:04.984039 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:04.992861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:04.994407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-69a11830-a704-4a87-935c-d568c7d74e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.467445 Sep 09 20:30:04.997351 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 144/293] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:04 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:05.002194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-006d0a21-b7f9-4100-962f-3b7e7ba362aa tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1510 microversion: 2.1 time: 0.356727 Sep 09 20:30:05.004998 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 150/294] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:04 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:05.338720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:05.339726 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:05.356676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:05.357212 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:05.358093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:05.360895 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:05.363200 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:05.363926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:05.705066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:05.717019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:05.724531 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:05.726536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e47546b-6334-442c-a0e3-71ac5300e74c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.393170 Sep 09 20:30:05.727360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 145/295] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:05 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:06.020941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:06.023758 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:06.034168 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:06.035176 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:06.036000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:06.036731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:06.037378 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:06.039072 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:06.040079 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:06.040966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:06.044587 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:06.046086 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:06.046984 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:06.048241 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:06.050788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:06.051594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:06.274649 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:06.293749 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e90ed4ba-475f-437d-819d-d91d1d5467ad tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1510 microversion: 2.1 time: 0.261180 Sep 09 20:30:06.294682 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 146/296] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:06 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:06.380712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:06.391609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f157a4fc-b877-49b3-ba71-606d669267be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.375022 Sep 09 20:30:06.409689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 151/297] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:06 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:06.759576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:06.760757 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:06.771403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:06.771893 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:06.772336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:06.773054 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:06.775710 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:06.777006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:06.957684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:06.968639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:06.970102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:06.971554 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-693c7331-1ce3-49e1-82f7-8a9565b647d7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.217554 Sep 09 20:30:06.972052 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 147/298] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:06 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:07.318352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:07.319142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:07.327626 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:07.329702 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:07.330727 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:07.331677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:07.332448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:07.335087 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:07.420682 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:07.422239 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:07.434658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:07.435391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:07.436327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:07.438136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:07.439227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:07.439662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:07.598964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:07.608712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ab216a9d-c911-4eb1-8ec7-a5e83e355eff tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1510 microversion: 2.1 time: 0.293887 Sep 09 20:30:07.610087 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 152/299] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:07 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:07.678859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:07.687683 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4fab2359-0260-4eaa-a1db-b8c567b1f9ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.273257 Sep 09 20:30:07.692902 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 148/300] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:07 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:08.006435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:08.007368 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:08.016696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:08.017185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:08.020753 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:08.021930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:08.022404 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:08.022838 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:08.237598 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:08.248033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:08.251782 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:08.253220 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-28b23b3f-12f6-4787-b9e2-b05b41fe1255 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.257509 Sep 09 20:30:08.253745 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 153/301] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:07 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:08.642639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:08.643404 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:08.651744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:08.652231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:08.652846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:08.653761 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:08.654364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:08.654802 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:08.716342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:08.717639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:08.732779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:08.738885 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:08.739303 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:08.740530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:08.741065 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:08.741627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:08.967211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:08.979710 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-056fc021-c5ed-4376-ab7b-eb0713d67c20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1510 microversion: 2.1 time: 0.343991 Sep 09 20:30:08.980887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 149/302] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:08 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:09.042485 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:09.053962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9203809e-56d9-46f9-b5f2-36f3be0f402b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.345439 Sep 09 20:30:09.071294 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 154/303] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:08 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:09.280330 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:09.280651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:09.286785 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:09.287271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:09.287893 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:09.288759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:09.289396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:09.289973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:09.515659 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:09.526669 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:09.528264 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:09.529500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ead0bfc-d3dd-4c52-ac9d-fe1b02ba2a8a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.253374 Sep 09 20:30:09.541590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 150/304] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:09 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:10.005922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:10.007278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:10.017748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:10.021046 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:10.021863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:10.023105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:10.028972 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:10.030208 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:10.091772 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:10.096229 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:10.112321 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=78 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:10.159687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:10.160889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:10.161375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:10.163281 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:10.164071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:10.164813 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:10.578417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:10.597433 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e69cda8f-48df-4e41-a06a-fc6d0108e5ff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.512180 Sep 09 20:30:10.610350 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 151/305] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:10 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:10.621889 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:10.632783 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:10.633001 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7baa32cf-b622-420c-bb2c-70f446b3f684 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1510 microversion: 2.1 time: 0.632282 Sep 09 20:30:10.634719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:10.636537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 155/306] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:09 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1510 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:10.656488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:10.658186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:10.658774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:10.660589 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:10.665647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:10.667356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:11.040441 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:11.061295 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:11.068027 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:11.069600 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-18777b32-7735-42c7-b4ca-a731d58f6590 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.461169 Sep 09 20:30:11.071769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 152/307] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:10 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:11.626374 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:11.627026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:11.637295 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:11.637836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:11.638264 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:11.638911 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:11.639447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:11.639798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:11.665322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:11.668889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:11.700872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:11.701518 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:11.701956 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:11.702704 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:11.703164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:11.703598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:12.327964 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:12.336037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6204b6da-59ff-4e59-88d6-4a21ca350027 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1516 microversion: 2.1 time: 0.679475 Sep 09 20:30:12.336622 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 153/308] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:11 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1516 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:12.346807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:12.360884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:12.387114 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:12.387896 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:12.388515 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:12.389590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:12.390212 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:12.390990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:12.577509 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:12.587276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-25efa3c5-56b0-4e34-8ab0-9f61ef9c49bb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.966433 Sep 09 20:30:12.599985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 156/309] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:11 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:12.982363 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:13.003385 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:13.005418 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:13.010879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1207c42d-8fd3-4a10-b638-e62b31366608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.669059 Sep 09 20:30:13.011430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 154/310] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:12 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:13.627377 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:13.627979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:13.643077 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:13.672128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:13.672839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:13.673617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:13.674073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:13.674494 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:14.042817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:14.046554 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:14.060696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:14.069507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:14.070221 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:14.071132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:14.071780 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:14.072399 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:14.430677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:14.444091 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a2e42ed-9c45-4590-8318-86877c8f0d1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1722 microversion: 2.1 time: 0.820742 Sep 09 20:30:14.445473 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 157/311] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:13 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1722 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:14.456530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-cd7c7cee-93ac-4241-8ecc-0c418c1edece tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'create', calling method: .version_select at 0x7f4834c844c0>, body: {"keypair": {"name": "tempest-keypair-811301452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFfWsY79wR1UWpRtURtvYm7LweEUxLm1SKRMcn/fYg91uGgT7Ui1TacihCtt94WifmZnqy93AOhoscLuDldTEdSDtkKexSuR2N/z3CmOrZBqd/DY8pLJILFk8NqQpTA0w=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:14.491612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-cd7c7cee-93ac-4241-8ecc-0c418c1edece tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for project f07defd609684351b4b7d0d110212a7c. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:30:14.496496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-cd7c7cee-93ac-4241-8ecc-0c418c1edece tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for user a95746e7a84541199b43138b1a348386 and project f07defd609684351b4b7d0d110212a7c. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:30:14.559585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-cd7c7cee-93ac-4241-8ecc-0c418c1edece tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108597 Sep 09 20:30:14.561480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 158/312] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:30:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:30:14.620019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:14.702764 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:14.736992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:14.750423 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9088116d-db5d-4505-aae7-8099f7ec4d77 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.708381 Sep 09 20:30:14.764119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 155/313] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:14 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:15.471823 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:15.473782 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:15.483539 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:15.495096 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:15.495676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:15.496527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:15.497084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:15.497658 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:15.769296 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:15.783946 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-15113a80-d10e-485b-95ab-955f1b785de8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1699 microversion: 2.1 time: 0.315218 Sep 09 20:30:15.785039 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 159/314] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:15 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1699 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:15.788176 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:15.788775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:15.798369 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:15.804819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:15.805312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:15.806087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:15.806558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:15.806990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:15.808704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e217bcde-1cff-496c-8197-9a59a2de9a7b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:15.821288 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e217bcde-1cff-496c-8197-9a59a2de9a7b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:15.822085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e217bcde-1cff-496c-8197-9a59a2de9a7b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:15.822692 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e217bcde-1cff-496c-8197-9a59a2de9a7b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:15.894699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e217bcde-1cff-496c-8197-9a59a2de9a7b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Going to try to start instance {{(pid=120679) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 20:30:15.930091 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:15.981682 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e217bcde-1cff-496c-8197-9a59a2de9a7b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action" status: 202 len: 0 microversion: 2.1 time: 0.176868 Sep 09 20:30:15.987544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 160/315] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:30:15 2022] POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 20:30:16.005104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:16.006520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:16.027968 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:16.029700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:16.030582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:16.032616 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:16.034962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:16.036910 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:16.436724 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:16.452647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:16.458461 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:16.461156 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44a4840f-25db-4ba5-92e2-c2561ffa8e62 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.676468 Sep 09 20:30:16.486126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 156/316] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:15 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:16.794438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:16.808687 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bd245ae1-19ff-4486-8c66-51c781d8d22b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1708 microversion: 2.1 time: 0.815913 Sep 09 20:30:16.816138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 161/317] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:15 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1708 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:17.502759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:17.504133 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:17.527497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:17.528705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:17.530945 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:17.533129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:17.534298 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:17.535300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:17.844207 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:17.845770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:17.865320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:17.866245 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:17.867459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:17.868985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:17.870324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:17.871120 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:18.339768 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:18.348658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:18.350203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:18.351355 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e1cf296e-d040-42b2-884f-11016768462a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.853052 Sep 09 20:30:18.351907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 157/318] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:17 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:18.677895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:18.707207 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ba64aca6-b8e2-4dab-a684-a350e4e5f819 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1708 microversion: 2.1 time: 0.874453 Sep 09 20:30:18.713313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 162/319] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:17 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1708 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:19.382790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:19.383883 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:19.420571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:19.422138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:19.423496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:19.426664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:19.429112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:19.431631 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:19.735577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:19.736985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:19.744800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:19.745583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:19.746324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:19.747382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:19.748263 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:19.748905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:19.903750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:19.934302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:19.936314 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:19.938539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4ea6fa70-47a9-4377-b507-aad009017575 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1747 microversion: 2.20 time: 0.560689 Sep 09 20:30:19.939643 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 158/320] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:19 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1747 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:20.107224 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:20.124014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed44e04a-42c5-4161-ad1f-4d42d3e5e33c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1708 microversion: 2.1 time: 0.392384 Sep 09 20:30:20.141738 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 163/321] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:19 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1708 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:20.179507 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1101957071", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b188b4ef-6195-4514-85bf-2356d78cce90"}], "security_groups": [{"name": "tempest-securitygroup--299412103"}], "key_name": "tempest-keypair-811301452", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:20.971820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:20.973300 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:20.993948 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:20.994446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:20.994882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:20.996445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:20.996445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:20.996445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:21.440894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:21.457282 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:21.462786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:21.470306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-efeab130-abeb-41d8-a182-330cfa3d4616 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.501095 Sep 09 20:30:21.471180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 164/322] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:20 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:21.486674 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:21.486674 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:21.500850 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:21.501484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:21.502038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:21.503144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:21.503688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:21.506037 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:21.864938 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:21.886643 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-53fd655a-8f87-4875-b992-be875c7f5916 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1712 microversion: 2.1 time: 0.411388 Sep 09 20:30:21.887234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 165/323] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:21 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1712 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:22.501497 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:22.503045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:22.515014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:22.519337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:22.519898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:22.546207 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:22.547143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:22.547847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:22.844910 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:22.874900 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:22.876419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:22.885554 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9761289d-c299-4234-91d4-2d95a1794662 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.389542 Sep 09 20:30:22.886341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 166/324] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:22 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:23.098863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-672f99b4-d896-42ca-b2b7-b8c9d92ef074 req-9c4a3601-4389-4c76-ae32-f0d3be36ed9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe125d2-51c7-4732-aa2a-90ab2d85d05f", "name": "network-vif-plugged", "status": "completed", "tag": "715458c7-e2c5-47e3-9ee4-1e82cbf7d53e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:23.118933 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-672f99b4-d896-42ca-b2b7-b8c9d92ef074 req-9c4a3601-4389-4c76-ae32-f0d3be36ed9d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:23.120119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-672f99b4-d896-42ca-b2b7-b8c9d92ef074 req-9c4a3601-4389-4c76-ae32-f0d3be36ed9d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:23.120561 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-672f99b4-d896-42ca-b2b7-b8c9d92ef074 req-9c4a3601-4389-4c76-ae32-f0d3be36ed9d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:23.135759 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-672f99b4-d896-42ca-b2b7-b8c9d92ef074 req-9c4a3601-4389-4c76-ae32-f0d3be36ed9d service nova] Creating event network-vif-plugged:715458c7-e2c5-47e3-9ee4-1e82cbf7d53e for instance abe125d2-51c7-4732-aa2a-90ab2d85d05f on hv-cinder-84932 Sep 09 20:30:23.141558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-672f99b4-d896-42ca-b2b7-b8c9d92ef074 req-9c4a3601-4389-4c76-ae32-f0d3be36ed9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061120 Sep 09 20:30:23.142527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 167/325] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:30:24.003071 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:24.003888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:24.016764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:24.017851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:24.019074 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:24.020054 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:24.021973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:24.022833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:24.309448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:24.328662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:24.344850 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:24.350333 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d79fbb1e-8f0b-4847-a907-a8261cc61438 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.398014 Sep 09 20:30:24.358557 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 168/326] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:23 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:25.391342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:25.393403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:25.407527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:25.411455 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:25.412029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:25.412557 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:25.413632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:25.414510 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:25.416890 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:25.718155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:25.728556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:25.731533 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:25.733849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-efcc2572-d6ab-4d09-adc5-cb3cea2e7c74 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.346630 Sep 09 20:30:25.735013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 169/327] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:25 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:26.768038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:26.770123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:26.781960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:26.785144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:26.785791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:26.788877 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:26.789756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:26.791637 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:27.000609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:27.020981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:27.023055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:27.025073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6648becb-6753-4af8-9876-7e5998954b7e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.260801 Sep 09 20:30:27.035667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 170/328] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:26 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:28.056712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:28.057603 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:28.068118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:28.068764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:28.069410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:28.070396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:28.070952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:28.071596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:28.416688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:28.426807 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:28.428569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:28.430041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e5d1d6c1-7216-48e6-886b-f482031eae88 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.378729 Sep 09 20:30:28.442614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 171/329] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:28 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:29.471813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:29.474923 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:29.486630 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:29.487289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:29.487799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:29.491590 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:29.492648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:29.493307 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:29.921101 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=88 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:30.058756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:30.073566 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:30.076351 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:30.077956 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a0e1dad-279a-4f8e-a432-03989b150825 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.613878 Sep 09 20:30:30.103998 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 172/330] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:29 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:30.194574 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=17 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:31.136027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:31.137369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:31.167779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:31.172100 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:31.173607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:31.174337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:31.175285 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:31.175930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:31.176807 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:31.587032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:31.595922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:31.598137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:31.599854 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9f91bde7-a74b-41a5-9b5c-0b7636d0aeef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.488302 Sep 09 20:30:31.601463 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 173/331] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:31 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:32.639876 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:32.641429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:32.648928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:32.650045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:32.650725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:32.651771 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:32.654935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:32.655796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:32.934994 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:32.951620 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:32.953884 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:32.955847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0ca42d7-587f-4f18-990e-47f4fd91d38d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.324924 Sep 09 20:30:32.957126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 174/332] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:32 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:33.992296 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:33.993000 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:34.022396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:34.022615 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:34.024842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:34.026070 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:34.026678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:34.027186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:34.316032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:34.330372 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:34.333047 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:34.335201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8950d9b8-445d-43e4-b030-bbd956d01de2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.346962 Sep 09 20:30:34.337657 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 175/333] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:33 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:35.363878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:35.369341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:35.384766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:35.387177 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:35.387895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:35.388855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:35.390872 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:35.392800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:35.677401 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:35.693206 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:35.711499 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:35.714520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22e1061f-9754-4932-94e6-37a18bba8d32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.356335 Sep 09 20:30:35.729896 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 176/334] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:35 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:35.964369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a6656156-fdc0-44fd-9259-4e1774b97fcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Action: 'create', calling method: .version_select at 0x7f4834c2d670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1530291827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHl0vFG0mmmmX5yuRun5Tn3ph22VF9q6lu1SVyrivIbb7/YA1NpWC3sF7pziKit3uaDdhewee6w4KqsjRP7B+QqATpbZiSgwv/NsgjA5SPuBKe+CJzDUeu0z3W7T/vLrA=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:35.995211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-a6656156-fdc0-44fd-9259-4e1774b97fcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Getting quotas for project da5cdb6c865f4345be2de638e6ded3c6. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:30:36.012888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-a6656156-fdc0-44fd-9259-4e1774b97fcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Getting quotas for user ec90aaf1a60746f69e5478987ab86bc1 and project da5cdb6c865f4345be2de638e6ded3c6. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:30:36.054437 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a6656156-fdc0-44fd-9259-4e1774b97fcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.098581 Sep 09 20:30:36.057379 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 177/335] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:30:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:30:36.336036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] validate_networks() for [('b188b4ef-6195-4514-85bf-2356d78cce90', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:30:36.360541 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1201449235", "imageRef": "f133d23b-8b7f-4746-bc3b-aaff4abfdfcb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1530291827", "networks": [{"uuid": "c6492b96-0167-457f-ad6b-c9784b1d6ec0"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:36.598140 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] validate_networks() for [('c6492b96-0167-457f-ad6b-c9784b1d6ec0', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:30:37.099981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:30:37.100278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:30:37.100744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:30:37.101388 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:30:37.102709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:30:37.113688 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:37.114660 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:37.115436 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:37.116511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:37.117840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:37.118641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:37.148647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for project f07defd609684351b4b7d0d110212a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:30:37.156613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Getting quotas for user a95746e7a84541199b43138b1a348386 and project f07defd609684351b4b7d0d110212a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:30:37.185018 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:30:37.187487 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:30:37.254163 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f18421c8-9c7e-460f-8461-86504b36af8d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 17.078918 Sep 09 20:30:37.262066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 159/336] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:30:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 17087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:30:37.268539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:37.270014 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:37.282725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:37.283109 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:37.284007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:37.285058 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:37.285750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:37.286409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:37.591981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:30:37.592645 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:30:37.593419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:30:37.593998 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:30:37.594582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:30:37.610785 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:37.613764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:37.614776 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:37.615396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:37.615852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:37.616282 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:37.684007 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Getting quotas for project da5cdb6c865f4345be2de638e6ded3c6. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:30:37.692114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Getting quotas for user ec90aaf1a60746f69e5478987ab86bc1 and project da5cdb6c865f4345be2de638e6ded3c6. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:30:37.725915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:30:37.732634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f133d23b-8b7f-4746-bc3b-aaff4abfdfcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:30:37.767896 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:37.782220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:37.786369 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:37.791485 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b42e96a-e242-467f-b525-80ee3d255922 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.525634 Sep 09 20:30:37.793121 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 160/337] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:37 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:37.829487 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c0930611-0dab-4b0c-bc7b-26a6baa498d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:37.832078 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c0930611-0dab-4b0c-bc7b-26a6baa498d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:37.847477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c28b554e-cef0-44f9-b508-8de74887013f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490721 Sep 09 20:30:37.854382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 178/338] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:30:37.866346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89fac7ca-b1d2-43f7-b1e3-866ab814f978 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:37.872362 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-89fac7ca-b1d2-43f7-b1e3-866ab814f978 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:37.995860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c0930611-0dab-4b0c-bc7b-26a6baa498d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:38.012289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c0930611-0dab-4b0c-bc7b-26a6baa498d8 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1245 microversion: 2.1 time: 0.207220 Sep 09 20:30:38.014166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 161/339] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:37 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1245 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:38.059429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-89fac7ca-b1d2-43f7-b1e3-866ab814f978 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:38.070234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89fac7ca-b1d2-43f7-b1e3-866ab814f978 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1259 microversion: 2.1 time: 0.214405 Sep 09 20:30:38.074681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 179/340] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:37 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:38.825458 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:38.826854 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:38.852856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:38.853387 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:38.853823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:38.854975 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:38.858072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:38.858695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:39.044394 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:39.045011 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:39.063302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:39.066111 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:39.066776 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:39.067926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:39.068400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:39.068834 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:39.080282 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:39.169517 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:39.179832 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:39.181994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:39.183189 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-45ac37c8-fa78-49c7-9ffd-73ecaf7f0908 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.363051 Sep 09 20:30:39.194748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 162/341] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:38 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:39.206594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:39.207728 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:39.215853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:39.216636 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:39.217472 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:39.218655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:39.219337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:39.223939 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:39.272875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:39.284343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c52a50f2-7d1c-4ddb-882d-682cb1cdcbaf tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1297 microversion: 2.1 time: 0.243807 Sep 09 20:30:39.287495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 180/342] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:39 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1297 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:39.330444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:39.341552 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdb6698a-d51f-43da-b20f-37ae57d9b8d9 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1255 microversion: 2.1 time: 0.145091 Sep 09 20:30:39.349302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 163/343] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:39 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1255 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:40.218933 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:40.220225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:40.230757 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:40.231452 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:40.232176 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:40.233107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:40.233973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:40.234577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:40.317098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:40.318873 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:40.351326 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:40.351897 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:40.352336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:40.353103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:40.361663 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:40.362197 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:40.542691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:40.568928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-31ad5179-076e-4e18-952e-db45e2d9fc92 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1303 microversion: 2.1 time: 0.259116 Sep 09 20:30:40.574670 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 164/344] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:40 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:40.584992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:40.586072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:40.595211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:40.596007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:40.596683 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:40.600770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:40.601615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:40.602288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:40.701431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:40.711533 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:40.732539 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:40.734157 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9d252cb5-549f-48fb-8162-0d3ff399bead tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.522514 Sep 09 20:30:40.740585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 181/345] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:40 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:40.770038 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:40.783045 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5370bc5d-2568-4639-8026-505601502a94 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1319 microversion: 2.1 time: 0.207029 Sep 09 20:30:40.785884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 165/346] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:40 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:41.595164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:41.597455 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:41.639188 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:41.639714 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:41.640164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:41.640892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:41.645962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:41.646556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:41.769050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:41.770485 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:41.798570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:41.803788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:41.805105 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:41.812594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:41.813350 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:41.817409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:42.231144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:42.252168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-47a2ac49-9081-40e0-94cd-68bfa615c695 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.659906 Sep 09 20:30:42.253429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 182/347] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:41 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:42.268620 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:42.270571 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:42.310974 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:42.313284 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:42.313729 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:42.317471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:42.317933 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:42.318378 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:42.531261 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:42.540794 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:42.546030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:42.561169 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8bc2fb0f-1761-49d6-81b5-d342dd463fe7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.796139 Sep 09 20:30:42.562079 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 166/348] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:41 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:42.566621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:42.577345 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a9fa8bd8-b308-4b07-8348-a2c2d71d6b8e tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1317 microversion: 2.1 time: 0.321810 Sep 09 20:30:42.580982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 183/349] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:42 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:43.285781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:43.286473 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:43.301664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:43.302155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:43.303155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:43.304021 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:43.304639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:43.305662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:43.559836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:43.572527 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-910445a0-3abf-49a4-ae32-ff2966fe7af6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.296626 Sep 09 20:30:43.583471 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 167/350] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:43 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:43.594828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:43.595570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:43.611186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:43.611852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:43.619402 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:43.621209 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:43.622929 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:43.623715 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:43.624267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:43.625049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:43.625578 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:43.625871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:43.628312 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:43.629069 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:43.636643 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:43.637406 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:44.065735 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:44.083990 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:44.090302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:44.095841 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e3507f56-beb4-44b9-9fc3-140e8f3c1a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.505094 Sep 09 20:30:44.100362 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 184/351] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:43 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:44.107784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8216185a-e159-43d8-a98a-a342b5560a0b req-57514a27-2296-460f-b8a9-6991a470633f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41051093-877e-41db-a9b9-d2c2624a3314", "tag": "21f730a2-1ecb-4742-8ea6-973064a729fc"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:44.135569 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:44.138123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8216185a-e159-43d8-a98a-a342b5560a0b req-57514a27-2296-460f-b8a9-6991a470633f service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:44.143804 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8216185a-e159-43d8-a98a-a342b5560a0b req-57514a27-2296-460f-b8a9-6991a470633f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:44.147769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8216185a-e159-43d8-a98a-a342b5560a0b req-57514a27-2296-460f-b8a9-6991a470633f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:44.150674 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-91bf8bf5-71a3-4c16-b4e0-c9078985e1df tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.549412 Sep 09 20:30:44.154645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 168/352] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:43 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:44.177145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8216185a-e159-43d8-a98a-a342b5560a0b req-57514a27-2296-460f-b8a9-6991a470633f service nova] Creating event network-changed:21f730a2-1ecb-4742-8ea6-973064a729fc for instance 41051093-877e-41db-a9b9-d2c2624a3314 on hv-cinder-84932 Sep 09 20:30:44.183530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8216185a-e159-43d8-a98a-a342b5560a0b req-57514a27-2296-460f-b8a9-6991a470633f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081561 Sep 09 20:30:44.184636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 185/353] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:30:44.600190 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:44.600816 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:44.615413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:44.616219 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:44.616821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:44.617984 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:44.618601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:44.619182 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:44.887561 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:44.896187 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-be1b48a9-437c-4f0f-8185-58f125599471 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.299855 Sep 09 20:30:44.897356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 169/354] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:44 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:45.133551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:45.135949 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:45.151196 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:45.153744 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:45.154193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:45.154895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:45.155343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:45.165666 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:45.181595 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:45.182539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:45.191148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:45.191642 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:45.192072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:45.192777 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:45.193227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:45.193671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:45.507604 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:45.517124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:45.522967 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:45.525530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-00c77bdf-418f-41ac-9700-57b780d5efb8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.398981 Sep 09 20:30:45.528348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 186/355] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:45 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:45.539046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:45.549121 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a2090377-0871-4aaa-aaf3-092c5208d66b tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.371766 Sep 09 20:30:45.549740 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 170/356] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:45 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:45.927751 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:45.928348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:45.939026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:45.947483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:45.947957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:45.948713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:45.949331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:45.949767 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:46.131117 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:46.142537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b75ff8aa-3bd0-4a21-ad80-8b5b4f4ad349 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.223098 Sep 09 20:30:46.143169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 187/357] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:45 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:46.350962 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c9f70ad0-8669-4c14-90c0-ea58e99962ae req-39e9dafa-199a-4282-b58f-c30c5ea5e661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5303a6-d80f-4a4f-831b-4432191724db", "tag": "b9b51f9a-0a54-4a10-bce6-3b821e125c22"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:46.362343 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9f70ad0-8669-4c14-90c0-ea58e99962ae req-39e9dafa-199a-4282-b58f-c30c5ea5e661 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:46.363099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9f70ad0-8669-4c14-90c0-ea58e99962ae req-39e9dafa-199a-4282-b58f-c30c5ea5e661 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:46.363733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c9f70ad0-8669-4c14-90c0-ea58e99962ae req-39e9dafa-199a-4282-b58f-c30c5ea5e661 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:46.381282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c9f70ad0-8669-4c14-90c0-ea58e99962ae req-39e9dafa-199a-4282-b58f-c30c5ea5e661 service nova] Creating event network-changed:b9b51f9a-0a54-4a10-bce6-3b821e125c22 for instance 7a5303a6-d80f-4a4f-831b-4432191724db on hv-cinder-84932 Sep 09 20:30:46.387394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c9f70ad0-8669-4c14-90c0-ea58e99962ae req-39e9dafa-199a-4282-b58f-c30c5ea5e661 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040356 Sep 09 20:30:46.388006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 171/358] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:30:46.558105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:46.559431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:46.591431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:46.592492 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:46.593182 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:46.594194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:46.594904 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:46.595568 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:46.613698 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:46.615088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:46.634645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:46.636438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:46.641411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:46.642794 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:46.643501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:46.646601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:46.983607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:47.002535 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:47.005983 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:47.010540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd0713af-0ee6-4ac9-aaeb-d0b9dc9e1b12 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.458281 Sep 09 20:30:47.011331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 188/359] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:46 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:47.046718 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:47.066592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c7c25526-1b85-4dd6-b010-4b8009a6e905 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.461977 Sep 09 20:30:47.069125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 172/360] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:46 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:47.166141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:47.166812 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:47.174314 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:47.176259 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:47.176927 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:47.177879 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:47.178551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:47.179201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:47.404701 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:47.412928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f80ed0d0-68b3-436b-8e74-7ce97b1ce3a2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.251254 Sep 09 20:30:47.428602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 189/361] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:47 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:48.041704 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:48.043270 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:48.045425 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:48.046839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=8 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:48.052949 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:48.053581 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:48.054246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:48.055170 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:48.055838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:48.056489 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:48.102099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:48.103005 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:48.105052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:48.105882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=12 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:48.117936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:48.118814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:48.119477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:48.120434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:48.121104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:48.121881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:48.334964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:48.341181 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:48.375218 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:48.376765 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:48.377515 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e057e2e8-3332-4285-8764-6cc038324f05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.272130 Sep 09 20:30:48.378115 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba1c1025-5304-4ae9-87a1-36c0fe5e6999 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.340931 Sep 09 20:30:48.378473 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 190/362] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:48 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:48.389726 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 173/363] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:48 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:48.436990 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:48.437654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:48.443993 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:48.444676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:48.445384 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:48.446240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:48.446750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:48.447277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:48.602399 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:48.615452 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae97c29e-1cc6-45a8-83d4-2ab13079e605 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.182525 Sep 09 20:30:48.617137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 191/364] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:48 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:30:49.405300 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:49.405895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:49.408843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:49.409479 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:49.419655 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:49.419968 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:49.420380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:49.421085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:49.430248 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:49.430447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:49.431077 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:49.434205 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:49.434944 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:49.438251 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:49.442499 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:49.443309 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:49.691075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:49.698533 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:49.701655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-027ba953-f8f9-46e6-82eb-1c2031ca084f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.305432 Sep 09 20:30:49.717529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:49.717529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:49.717529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ef199987-6aae-4b64-b185-01c6d6cbdbc0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.311722 Sep 09 20:30:49.717818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 192/365] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:49 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:49.717818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:49.717818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:49.718717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 174/366] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:49 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:49.723974 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:49.724471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:49.724907 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:49.725633 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:49.726083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:49.727047 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:49.870119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:49.878165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1c0462e6-328d-406f-a8b5-f7363220767a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.164789 Sep 09 20:30:49.889508 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 193/367] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:49 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:50.729877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:50.731640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:50.738357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:50.739278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:50.739879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:50.740784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:50.741613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:50.742461 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:50.747239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:50.748007 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:50.755886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:50.756385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:50.756825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:50.758960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:50.759433 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:50.759867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:50.990164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:50.998216 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:51.002639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:51.006572 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:51.007728 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-590df018-8d1b-42f0-923d-4ebce2090662 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.283282 Sep 09 20:30:51.008710 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 175/368] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:50 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:51.013316 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:51.013936 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:51.020008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:51.020498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:51.020929 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:51.021667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:51.022119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:51.022527 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:51.025704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9dbb5aaf-9ab0-4007-868a-b53e113c5080 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.264710 Sep 09 20:30:51.026621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 194/369] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:50 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:51.221259 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:51.231150 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4821c449-08fc-4d32-8a12-9017a6e985f4 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.220986 Sep 09 20:30:51.231927 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 176/370] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:51 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:52.033229 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:52.034041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:52.040994 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:52.041491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:52.041921 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:52.042603 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:52.043043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:52.043454 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:52.053838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:52.055670 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:52.065884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:52.066725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:52.067469 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:52.068400 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:52.069097 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:52.069860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:52.273221 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:52.280629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:52.283330 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4deb393e-e367-4d11-86ac-abed7a6e9233 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.253839 Sep 09 20:30:52.284426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 195/371] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:52 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:52.289754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:52.290082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:52.290579 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:52.296457 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:52.299667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:52.300615 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:52.301041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-03496ff2-d374-46c7-a64e-c85d301c9c17 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.251186 Sep 09 20:30:52.301168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:52.301562 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:52.302451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:52.303066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:52.303650 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:52.306022 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 177/372] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:52 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:52.481788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:52.489863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7d858ec1-824e-485d-9516-4f9efdad8f6c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.204272 Sep 09 20:30:52.490622 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 196/373] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:52 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:53.307260 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:53.307811 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:53.315566 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:53.316245 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:53.317033 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:53.317984 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:53.318541 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:53.319073 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:53.335253 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:53.337340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:53.344480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:53.345191 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:53.345892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:53.346722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:53.347384 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:53.347810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:53.370951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:30:53.560663 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:53.575672 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5623c031-d7d3-48cd-8c04-bf7ac83ed65a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.271688 Sep 09 20:30:53.578370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 178/374] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:53 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:53.584610 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:53.585442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:53.594015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:53.594886 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:53.595559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:53.595755 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:53.596679 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:53.597309 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:53.598002 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:53.606495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:53.611185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:53.612622 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a4a1ec67-defb-40fb-af86-1900c6210d95 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.281636 Sep 09 20:30:53.614240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 197/375] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:53 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:53.748476 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:53.756599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed56b44c-faa4-4316-aa1f-1906c628a878 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.176944 Sep 09 20:30:53.760833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 179/376] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:53 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:54.602039 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:54.602653 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:54.611579 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:54.612071 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:54.612571 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:54.613288 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:54.614003 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:54.614425 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:54.643989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:54.644625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:54.675908 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:54.676609 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:54.677196 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:54.678803 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:54.679660 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:54.680344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:54.979856 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:54.991300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:55.000305 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fd502c1d-4785-410d-9ee0-7570bac2eeaf tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.402146 Sep 09 20:30:55.001043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 198/377] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:54 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:55.021351 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:55.022087 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:55.022593 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:55.027901 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:55.030742 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-56550a01-9369-4805-b685-b331e670b9e0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.393119 Sep 09 20:30:55.033225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 180/378] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:54 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:55.037689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:55.038185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:55.042830 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:55.043633 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:55.044367 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:55.044821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:55.229654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:55.237895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dba50e50-2cd1-4ae9-bdb1-8e582e490688 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.234014 Sep 09 20:30:55.238954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 199/379] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:55 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:55.297803 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-08d1940e-d49c-46ff-91fd-d4bbb51a1e81 req-ac3b44ea-e9c8-44b7-99da-adb4eb2b5a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41051093-877e-41db-a9b9-d2c2624a3314", "name": "network-vif-plugged", "status": "completed", "tag": "21f730a2-1ecb-4742-8ea6-973064a729fc"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:30:55.309504 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-08d1940e-d49c-46ff-91fd-d4bbb51a1e81 req-ac3b44ea-e9c8-44b7-99da-adb4eb2b5a7f service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:55.310880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-08d1940e-d49c-46ff-91fd-d4bbb51a1e81 req-ac3b44ea-e9c8-44b7-99da-adb4eb2b5a7f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:55.311608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-08d1940e-d49c-46ff-91fd-d4bbb51a1e81 req-ac3b44ea-e9c8-44b7-99da-adb4eb2b5a7f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:55.329031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-08d1940e-d49c-46ff-91fd-d4bbb51a1e81 req-ac3b44ea-e9c8-44b7-99da-adb4eb2b5a7f service nova] Creating event network-vif-plugged:21f730a2-1ecb-4742-8ea6-973064a729fc for instance 41051093-877e-41db-a9b9-d2c2624a3314 on hv-cinder-84932 Sep 09 20:30:55.334600 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-08d1940e-d49c-46ff-91fd-d4bbb51a1e81 req-ac3b44ea-e9c8-44b7-99da-adb4eb2b5a7f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040587 Sep 09 20:30:55.335350 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 181/380] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:30:56.024219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:56.024944 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:56.031882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:56.032568 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:56.033010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:56.033894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:56.034352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:56.034780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:56.064978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:56.065928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:56.072437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:56.072925 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:56.073403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:56.074160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:56.074553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:56.074982 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:56.244639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:56.253631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2302bb8d-befa-4a0d-8c61-75ecfbc0418c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.233151 Sep 09 20:30:56.265268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 200/381] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:56 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:56.265268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:56.265268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:56.279842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:56.280344 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:56.280781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:56.280926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:56.281532 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:56.282157 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:56.290079 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:56.312989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:56.314970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:56.316621 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-06a20d6c-89f2-4fb2-8ec7-c4ce65f209fb tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.256328 Sep 09 20:30:56.317708 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 182/382] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:56 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:56.439277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:56.447518 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-debc8242-ff04-4609-b434-b14ca024c055 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.188689 Sep 09 20:30:56.448104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 201/383] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:56 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:57.282164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:57.282917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:57.289710 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:57.290317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:57.290820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:57.291591 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:57.292236 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:57.292721 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:57.343511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:57.344086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:57.353322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:57.353923 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:57.354433 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:57.355356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:57.355880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:57.356487 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:57.775678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:57.783562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-eca3f013-b794-485c-b374-12f04c30703f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.505162 Sep 09 20:30:57.784912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 183/384] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:57 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:57.796623 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:57.797262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:57.803962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:57.809932 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:57.810414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:57.810849 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:57.811563 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:57.812019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:57.812445 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:57.813463 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:57.815014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:57.816344 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c2cd6040-0dbc-4613-81f8-6a7a2972491d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.476609 Sep 09 20:30:57.816911 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 202/385] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:57 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:30:57.984064 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:57.996234 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bed0624f-71b7-456a-9df4-c9fc05ae3ab9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.210591 Sep 09 20:30:57.996468 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 184/386] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:57 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:58.808103 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:58.808835 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:58.816081 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:58.817045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:58.817885 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:58.819006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:58.820331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:58.823915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:58.842181 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:58.842881 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:58.850160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:58.850650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:58.851164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:58.851856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:58.852304 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:58.852721 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:59.048266 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:59.059862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1da7333b-f679-4de2-8c99-36709b1bc3ae tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.255625 Sep 09 20:30:59.060448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 203/387] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:58 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:30:59.068592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:59.070985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:30:59.071803 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:30:59.080138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:59.081642 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:59.082801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d7886c53-0fc7-41a7-adb5-6c32a0ea0c8f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.244770 Sep 09 20:30:59.083177 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:59.083616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 185/388] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:30:58 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:30:59.083733 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:59.084128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:59.084813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:30:59.085306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:30:59.086285 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:30:59.242119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:30:59.253157 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dde9087a-413b-46b4-b3e7-6b106a43c67a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.187576 Sep 09 20:30:59.254010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 204/389] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:30:59 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:00.082194 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:00.082807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:00.089269 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:00.089760 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:00.090195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:00.090879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:00.091336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:00.091761 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:00.107892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:00.108496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:00.115266 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:00.115756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:00.116194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:00.117471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:00.117923 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:00.118346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:00.281555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:00.290051 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9176c299-2834-4de1-aa70-59c87fab3dcb tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.211673 Sep 09 20:31:00.290217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:00.290861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 186/390] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:00 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:00.295056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:00.295655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:00.297542 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:00.299313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:00.300773 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:00.302143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-02dd59d9-48ec-4de3-98bd-1c6de3df47ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.198215 Sep 09 20:31:00.305282 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 205/391] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:00 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:31:00.305424 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:00.305424 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:00.305424 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:00.305424 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:00.305751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:00.306376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:00.438747 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:00.446361 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8924587-44e6-4886-913d-4c2b5bb55adb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.154814 Sep 09 20:31:00.447189 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 187/392] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:00 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:01.314051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:01.314729 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:01.317016 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:01.322292 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:01.322769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:01.323204 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:01.323886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:01.324331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:01.324748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:01.328186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:01.328824 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:01.336000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:01.336301 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:01.336735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:01.337461 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:01.337914 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:01.338337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:01.528339 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:01.532196 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:01.535980 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3abc35e0-850e-4bee-b841-a1e46de0d9ea tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.225767 Sep 09 20:31:01.536549 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 206/393] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:01 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:01.540508 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:01.540926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:01.541554 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:01.541970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:01.543107 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0028ecfe-17b0-4d02-b0ea-32d6c176a0db tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1742 microversion: 2.20 time: 0.219077 Sep 09 20:31:01.543780 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 188/394] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:01 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:01.547306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:01.547792 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:01.548224 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:01.548909 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:01.549386 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:01.549810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:01.677577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:01.685185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-90c58bcd-aa2a-42ee-8129-393e152f786c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.147703 Sep 09 20:31:01.685779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 207/395] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:01 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:02.559520 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:02.560138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:02.567975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:02.568947 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:02.580779 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:02.582062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:02.582554 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:02.583215 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:02.583832 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:02.584422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:02.586495 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:02.587279 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:02.587578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:02.589855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:02.590336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:02.590933 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:02.830910 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:02.860530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-610b663c-64f2-42e4-8692-c07c53492b88 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.299025 Sep 09 20:31:02.869886 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 189/396] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:02 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:02.874419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:02.875857 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:02.876463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:02.882776 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:02.883274 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:02.883408 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:02.883702 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:02.884396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:02.884843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:02.885278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:02.885387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:02.886626 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e15a15ae-fb2c-4a7f-9cd4-b3ed2ada8df7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1724 microversion: 2.20 time: 0.322602 Sep 09 20:31:02.887285 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 208/397] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:02 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:03.065971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:03.074972 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36ca6645-285f-440c-aee1-d9dff9b20e6e tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1370 microversion: 2.1 time: 0.204033 Sep 09 20:31:03.075971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 190/398] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:02 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:03.879559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:03.880157 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:03.887106 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:03.887578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:03.888001 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:03.888673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:03.889113 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:03.889559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:03.912785 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:03.913478 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:03.920031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:03.920549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:03.920979 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:03.921704 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:03.922173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:03.922592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:04.084593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:04.093503 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe8fc22c-480f-4cf9-af0e-c95ec98af42c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.217522 Sep 09 20:31:04.094313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 209/399] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:03 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:04.095247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:04.103878 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:04.105568 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:04.106717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-220536c5-6543-475e-9bed-45968d5c19dc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1724 microversion: 2.20 time: 0.198011 Sep 09 20:31:04.107265 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 191/400] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:03 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:04.121443 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:04.121443 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:04.122643 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:04.123178 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:04.123645 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:04.124527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:04.125067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:04.125743 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:04.277764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:04.285907 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c0424e80-4cf1-4e54-b73f-73a3dad21cd0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1565 microversion: 2.1 time: 0.179432 Sep 09 20:31:04.286465 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 210/401] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:04 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:04.308817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:04.309331 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:04.315146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:04.315622 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:04.316045 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:04.316716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:04.317158 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:04.317599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:04.394993 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e32462eb-3912-4cd8-9abf-341d7ed279fb tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090192 Sep 09 20:31:04.395630 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 192/402] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:31:04 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:05.121513 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:05.122155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:05.130452 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:05.130944 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:05.131360 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:05.132164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:05.132628 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:05.133057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:05.133955 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:05.134614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:05.141047 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:05.141798 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:05.142236 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:05.142938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:05.143392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:05.143816 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:05.433485 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:05.441553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:05.443014 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:05.444183 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ba8bfcb9-0347-4c03-913e-4370d26c2313 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1724 microversion: 2.20 time: 0.316090 Sep 09 20:31:05.444778 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 193/403] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:05 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:05.448926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:05.456678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-948a23ad-f2dc-43e5-9fe4-4fafea6e53d4 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.339148 Sep 09 20:31:05.469406 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 211/404] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:05 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:05.546340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-529796eb-8256-4628-8bc5-fd41e38f35dc req-7a77838b-f7a1-44d4-b27d-db050763d7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41051093-877e-41db-a9b9-d2c2624a3314", "tag": "21f730a2-1ecb-4742-8ea6-973064a729fc"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:05.555883 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-529796eb-8256-4628-8bc5-fd41e38f35dc req-7a77838b-f7a1-44d4-b27d-db050763d7a7 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:05.556360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-529796eb-8256-4628-8bc5-fd41e38f35dc req-7a77838b-f7a1-44d4-b27d-db050763d7a7 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:05.556790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-529796eb-8256-4628-8bc5-fd41e38f35dc req-7a77838b-f7a1-44d4-b27d-db050763d7a7 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:05.567655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-529796eb-8256-4628-8bc5-fd41e38f35dc req-7a77838b-f7a1-44d4-b27d-db050763d7a7 service nova] Creating event network-changed:21f730a2-1ecb-4742-8ea6-973064a729fc for instance 41051093-877e-41db-a9b9-d2c2624a3314 on hv-cinder-84932 Sep 09 20:31:05.573291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-529796eb-8256-4628-8bc5-fd41e38f35dc req-7a77838b-f7a1-44d4-b27d-db050763d7a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030623 Sep 09 20:31:05.573952 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 194/405] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:05.951013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-bcbed952-61c1-4109-857c-75a4b80cf0a7 req-ef5bd8e5-ff26-41df-b8e5-18a8902bbbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5303a6-d80f-4a4f-831b-4432191724db", "name": "network-vif-plugged", "status": "completed", "tag": "b9b51f9a-0a54-4a10-bce6-3b821e125c22"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:05.960663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bcbed952-61c1-4109-857c-75a4b80cf0a7 req-ef5bd8e5-ff26-41df-b8e5-18a8902bbbb0 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:05.961139 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bcbed952-61c1-4109-857c-75a4b80cf0a7 req-ef5bd8e5-ff26-41df-b8e5-18a8902bbbb0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:05.961589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-bcbed952-61c1-4109-857c-75a4b80cf0a7 req-ef5bd8e5-ff26-41df-b8e5-18a8902bbbb0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:05.972531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-bcbed952-61c1-4109-857c-75a4b80cf0a7 req-ef5bd8e5-ff26-41df-b8e5-18a8902bbbb0 service nova] Creating event network-vif-plugged:b9b51f9a-0a54-4a10-bce6-3b821e125c22 for instance 7a5303a6-d80f-4a4f-831b-4432191724db on hv-cinder-84932 Sep 09 20:31:05.977448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-bcbed952-61c1-4109-857c-75a4b80cf0a7 req-ef5bd8e5-ff26-41df-b8e5-18a8902bbbb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030149 Sep 09 20:31:05.978211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 212/406] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:06.471185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:06.471874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:06.478602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:06.479075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:06.479501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:06.480182 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:06.480625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:06.481036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:06.481924 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:06.482624 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:06.489412 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:06.490107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:06.490729 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:06.492027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:06.492483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:06.492935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:06.683302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:06.692884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:06.694398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:06.695558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8bd5d35c-6031-4a64-a99f-628c60558f9a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1724 microversion: 2.20 time: 0.229102 Sep 09 20:31:06.696678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 195/407] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:06 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:06.698277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:06.706163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-33156ad8-ecaf-4e39-aee5-60f8afa80c05 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.229341 Sep 09 20:31:06.706721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 213/408] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:06 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:07.722459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:07.724001 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:07.731050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:07.731684 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:07.732738 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:07.733386 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:07.734009 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:07.734706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:07.735155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:07.735585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:07.740536 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:07.741238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:07.741695 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:07.742355 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:07.743313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:07.744009 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:07.744674 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:07.979713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:07.983748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:07.987457 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:07.988020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:07.990352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:07.992122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d8a669b2-6de4-4995-a881-4f74ff5367ed tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1727 microversion: 2.20 time: 0.273201 Sep 09 20:31:07.992684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 196/409] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:07 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:07.993909 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2cff79af-cbb5-4d1a-a0b5-a66038c588d6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.266948 Sep 09 20:31:07.994477 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 214/410] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:07 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:07.997166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-67235f66-0a93-4ae2-9d86-7da37a9802f0 req-3eb6fffe-a626-41b4-8651-03007d017ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe125d2-51c7-4732-aa2a-90ab2d85d05f", "name": "network-vif-unplugged", "status": "completed", "tag": "715458c7-e2c5-47e3-9ee4-1e82cbf7d53e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:08.007095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-67235f66-0a93-4ae2-9d86-7da37a9802f0 req-3eb6fffe-a626-41b4-8651-03007d017ed6 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:08.007568 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-67235f66-0a93-4ae2-9d86-7da37a9802f0 req-3eb6fffe-a626-41b4-8651-03007d017ed6 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:08.007997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-67235f66-0a93-4ae2-9d86-7da37a9802f0 req-3eb6fffe-a626-41b4-8651-03007d017ed6 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:08.017008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b55a10b-ab94-43b7-8634-927d1d5b1ccf"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:08.018839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-67235f66-0a93-4ae2-9d86-7da37a9802f0 req-3eb6fffe-a626-41b4-8651-03007d017ed6 service nova] Creating event network-vif-unplugged:715458c7-e2c5-47e3-9ee4-1e82cbf7d53e for instance abe125d2-51c7-4732-aa2a-90ab2d85d05f on hv-cinder-84932 Sep 09 20:31:08.019414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:08.023794 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-67235f66-0a93-4ae2-9d86-7da37a9802f0 req-3eb6fffe-a626-41b4-8651-03007d017ed6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030005 Sep 09 20:31:08.024379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 197/411] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:08.025497 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:08.025987 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:08.026431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:08.027123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:08.027634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:08.027985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:08.326611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf66c76c-922f-4dcb-ab66-4e7cfbba3c2e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313695 Sep 09 20:31:08.327243 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 215/412] 10.222.0.26 () {62 vars in 1364 bytes} [Fri Sep 9 20:31:08 2022] POST /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:31:08.453767 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:08.454447 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:08.460603 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:08.461084 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:08.461537 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:08.462229 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:08.462681 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:08.463103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:08.507667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 20:31:08.581659 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b99483f7-72ef-4d58-a6f2-531967d008e7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/action" status: 202 len: 0 microversion: 2.20 time: 0.131961 Sep 09 20:31:08.582335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 198/413] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Sep 9 20:31:08 2022] POST /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 20:31:08.596723 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:08.597855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:08.607844 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:08.608213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:08.609062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:08.610030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:08.610707 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:08.611355 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:08.772014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:08.782891 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:08.784330 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:08.785571 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-574ddd83-abec-4f45-bbb6-fa4eb5a74874 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1813 microversion: 2.20 time: 0.197067 Sep 09 20:31:08.786124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 216/414] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:08 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1813 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:09.016320 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:09.016930 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:09.022881 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:09.023364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:09.023864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:09.024716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:09.025187 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:09.025646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:09.186151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:09.195028 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3007c682-4f59-42e4-a114-596f579c004f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1359 microversion: 2.1 time: 0.182359 Sep 09 20:31:09.195638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 199/415] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:09 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:09.812788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:09.814366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:09.823608 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:09.823918 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:09.824481 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:09.825455 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:09.826358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:09.827207 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:09.978940 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:09.988030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:09.990431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:09.992302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b303b99b-3814-4d2f-ab93-8bcb0df5abf8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1755 microversion: 2.20 time: 0.184183 Sep 09 20:31:09.992861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 217/416] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:09 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:10.217309 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:10.217912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:10.224251 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.224725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.225149 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.226471 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.226874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.227287 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.293583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:10.294183 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:10.300471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.301039 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.301588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.302364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.302883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.303366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.360186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:10.367950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f6d097e-3b1d-4d82-a880-36c69d26a6a3 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1549 microversion: 2.1 time: 0.154541 Sep 09 20:31:10.368533 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 200/417] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:10 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:10.390469 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:10.391125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:10.397186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.398196 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.398626 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.399348 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.399799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.400218 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.431966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lazy-loading 'services' on Instance uuid 7e0ef033-9a7a-4b4d-8c77-2e52b202adec {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:31:10.562814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-03240a42-715f-4851-953b-2c67c415173b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-volume_attachments/e368782c-e909-4b29-9083-ba80b74d5645" status: 202 len: 0 microversion: 2.1 time: 0.273389 Sep 09 20:31:10.563603 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 218/418] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:31:10 2022] DELETE /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-volume_attachments/e368782c-e909-4b29-9083-ba80b74d5645 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 20:31:10.584559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:10.601522 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-70cf3e3d-239c-4cb7-b66b-083a5ba4c059 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1549 microversion: 2.1 time: 0.214873 Sep 09 20:31:10.605276 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 201/419] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:10 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:10.629217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:10.639712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:10.640799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Searching by: {'deleted': False, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6'} {{(pid=120679) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 20:31:10.651582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.652060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.652490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.653219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.653688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.656982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.754998 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.multi_cell_list [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120679) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 20:31:10.846445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-36ce735f-4041-4f31-86fe-94112517a796 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.222236 Sep 09 20:31:10.849380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 219/420] 10.222.0.26 () {58 vars in 1125 bytes} [Fri Sep 9 20:31:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:10.859448 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:10.860304 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:10.867226 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.867735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.868161 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:10.868844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:10.869312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:10.869731 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:11.007979 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:11.018621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:11.019344 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:11.023544 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-73be0714-dfbf-41bf-82ce-962f9f9df106 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1549 microversion: 2.1 time: 0.167913 Sep 09 20:31:11.025631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:11.037540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 202/421] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:10 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:11.038380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:11.038380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:11.038380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:11.038380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:11.038726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:11.181027 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:11.189931 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:11.191365 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:11.192528 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8cf488b3-28f5-4898-8cd8-448fccf076d4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1755 microversion: 2.20 time: 0.177888 Sep 09 20:31:11.193073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 220/422] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:11 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:31:12.220024 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:12.220623 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:12.228400 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:12.228887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:12.229576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:12.230274 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:12.230729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:12.231155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:12.382614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:12.391721 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:12.392933 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:12.394233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6cd1031c-02da-4673-9e2f-27c894cd31cc tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.178208 Sep 09 20:31:12.409830 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 203/423] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:12 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:12.602644 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d483319f-8316-4976-b3ad-1b43e46d10af"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:12.604962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:12.611124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:12.611619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:12.612029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:12.612716 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:12.613167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:12.613893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:12.775544 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e1abfbd-70a7-4a6e-9be0-2221a51bb8cb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:12.781552 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1abfbd-70a7-4a6e-9be0-2221a51bb8cb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:12.782035 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1abfbd-70a7-4a6e-9be0-2221a51bb8cb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:12.782659 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e1abfbd-70a7-4a6e-9be0-2221a51bb8cb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:12.807530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e1abfbd-70a7-4a6e-9be0-2221a51bb8cb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Going to try to stop instance {{(pid=120680) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 20:31:12.856174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e1abfbd-70a7-4a6e-9be0-2221a51bb8cb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action" status: 202 len: 0 microversion: 2.1 time: 0.084202 Sep 09 20:31:12.859900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 204/424] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:31:12 2022] POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 20:31:12.866129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:12.866927 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:12.873431 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:12.874009 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:12.874540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:12.875314 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:12.875842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:12.876336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:12.971581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5001520-608a-4013-b8b1-3cd98fc96bb8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372642 Sep 09 20:31:12.972367 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 221/425] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:31:12 2022] POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:13.032725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:13.042772 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0e09e634-c3d6-4efe-b308-f3e3b152bb2e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.180644 Sep 09 20:31:13.057490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 205/426] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:12 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:13.427955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:13.429384 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:13.438659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:13.439742 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:13.440137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:13.441299 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:13.441991 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:13.442564 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:13.646212 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:13.659067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:13.660946 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:13.662340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78e88ffe-b5dc-40b0-ae13-a43c8a1784ac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.240290 Sep 09 20:31:13.679363 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 222/427] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:13 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:14.072849 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:14.073649 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:14.093444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:14.095501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:14.096675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:14.097994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:14.099753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:14.101072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:14.344992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:14.355410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a101351f-8132-413b-815a-90694d0cd58e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.292609 Sep 09 20:31:14.356441 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 206/428] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:14 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:14.690920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:14.691499 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:14.702235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:14.703136 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:14.703857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:14.704745 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:14.705433 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:14.706232 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:14.880429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:14.889696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:14.902771 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:14.904388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ab536e6-daf3-406a-810a-59f744d8c46e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.217630 Sep 09 20:31:14.917537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 223/429] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:14 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:15.381274 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:15.381906 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:15.388395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:15.388885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:15.389366 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:15.390070 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:15.390529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:15.390954 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:15.596050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:15.607020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5cf15ac-54fc-46a3-a78b-67ce2a3300d9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.229310 Sep 09 20:31:15.608414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 207/430] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:15 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:15.935761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:15.936475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:15.942878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:15.943419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:15.943886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:15.945151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:15.945627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:15.946046 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:16.093410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:16.105272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:16.106810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:16.107998 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3d80032a-5067-4014-a4bd-a3b66ee3027c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.176283 Sep 09 20:31:16.108565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 224/431] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:15 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:31:16.631199 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:16.632641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:16.639607 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:16.640425 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:16.641095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:16.642044 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:16.642718 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:16.643346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:16.824014 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:16.833198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ca1c7b4a-b9cb-42fd-b5bf-5b4476af0a7c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.205745 Sep 09 20:31:16.834300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 208/432] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:16 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:16.899521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-469404296", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:16.961040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] validate_networks() for None {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:31:17.135388 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:17.136412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:17.143490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:17.144363 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:17.144959 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:17.145755 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:17.146235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:17.146893 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:17.541137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:31:17.541451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:31:17.542243 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:31:17.542243 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:31:17.544179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:31:17.552211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:17.553048 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:17.553420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:17.553954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:17.556225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:17.556678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:17.564489 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:17.576355 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:17.577872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:17.579107 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1663dcc8-e7c1-463a-ba93-e5bd4f67da8e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.449557 Sep 09 20:31:17.579668 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 209/433] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:17 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:31:17.582329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Getting quotas for project 2f672a6f47c84495986796b8814900b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:31:17.587268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Getting quotas for user a6ea21f089fa47b38fc6e9835a72ede8 and project 2f672a6f47c84495986796b8814900b2. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:31:17.600979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:31:17.603329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:31:17.649767 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-41484714-8c2f-4951-b842-29522ece9978 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754515 Sep 09 20:31:17.650695 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 225/434] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:31:17.666727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-95c0c826-414b-4230-8351-127be365eb19 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:17.667936 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-95c0c826-414b-4230-8351-127be365eb19 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:17.737773 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-95c0c826-414b-4230-8351-127be365eb19 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:17.749554 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-95c0c826-414b-4230-8351-127be365eb19 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1214 microversion: 2.1 time: 0.087032 Sep 09 20:31:17.750336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 210/435] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:17 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:17.865082 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:17.865760 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:17.874333 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:17.881591 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:17.882709 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:17.884718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:17.885889 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:17.886839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:18.057101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:18.066667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3d7bcab7-c80f-4f78-b53f-a0358cb77c12 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.205905 Sep 09 20:31:18.067250 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 226/436] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:17 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:18.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:18.604619 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:18.611252 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:18.612002 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:18.612614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:18.613791 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:18.614255 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:18.614740 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:18.759388 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:18.770628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:18.773328 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:18.774159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:18.781953 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:18.782369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:18.782815 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:18.783727 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:18.784294 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:18.784409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:18.784843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:18.788270 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a13cb54b-9cb3-48aa-8604-62a51c51dd05 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.186314 Sep 09 20:31:18.797936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:18.798158 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 211/437] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:18 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:18.881359 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:18.891504 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d0042195-277f-49d6-b90c-b6b28fded185 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1218 microversion: 2.1 time: 0.122895 Sep 09 20:31:18.892101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 227/438] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:18 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:19.090460 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:19.091611 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:19.098218 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:19.098710 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:19.099152 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:19.099884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:19.100342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:19.100811 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:19.121291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:19.250706 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:19.259099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0001b6f2-f6c0-400e-81bb-081c945aff4b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.172847 Sep 09 20:31:19.260662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 212/439] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:19 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:19.816021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:19.816641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:19.823771 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:19.824252 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:19.824684 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:19.825604 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:19.826057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:19.826478 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:19.916530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:19.917444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:19.924557 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:19.925480 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:19.927467 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:19.930249 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:19.931058 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:19.931646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:19.991502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:20.001582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:20.003320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:20.005119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c5cd3edf-e107-4ac2-9d0e-4a905eee783d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.192822 Sep 09 20:31:20.017579 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 228/440] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:19 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:20.026561 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:20.034367 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2af33073-f4b9-4d95-b4a4-daaf7f23f012 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1218 microversion: 2.1 time: 0.122314 Sep 09 20:31:20.034942 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 213/441] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:19 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:20.282967 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:20.283765 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:20.290012 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:20.290612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:20.291155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:20.291960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:20.292531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:20.293187 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:20.425831 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:20.434272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ff14d45-12e9-41f7-aa06-f99e6a90c208 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.155308 Sep 09 20:31:20.435213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 229/442] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:20 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:21.033209 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:21.033840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:21.040931 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:21.041438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:21.041872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:21.042558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:21.043009 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:21.043429 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:21.057484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:21.058173 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:21.064507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:21.064997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:21.065470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:21.066168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:21.066626 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:21.067050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:21.151257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:21.158793 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1dcc2b4c-3f88-447c-a7e1-e2ceac38edd4 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1218 microversion: 2.1 time: 0.105187 Sep 09 20:31:21.159366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 230/443] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:21 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:21.220165 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:21.228895 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:21.230371 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:21.231527 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48ec5f39-5146-46c9-b6dd-7df2d86b2d9f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.202204 Sep 09 20:31:21.232079 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 214/444] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:21 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:21.457402 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:21.458012 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:21.464611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:21.465083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:21.465546 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:21.466231 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:21.466687 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:21.467109 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:21.591358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:21.599105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe67e93c-9054-44bc-a938-27e22e13db0b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.145650 Sep 09 20:31:21.599666 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 231/445] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:21 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:22.181554 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:22.182166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:22.188491 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:22.188968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:22.189438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:22.190120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:22.190571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:22.190993 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:22.253075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:22.256520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:22.257114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:22.260825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ec27c921-de42-4e2d-9868-d92ae7b781ff tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1210 microversion: 2.1 time: 0.083758 Sep 09 20:31:22.261622 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 215/446] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:22 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:22.263472 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:22.264078 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:22.264467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:22.265403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:22.265851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:22.266268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:22.397527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:22.409839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:22.411287 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:22.413003 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7aefde8e-a6a3-4e3e-91eb-e8b53a259398 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.159842 Sep 09 20:31:22.413589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 232/447] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:22 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:31:22.624809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:22.625443 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:22.632067 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:22.632689 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:22.633159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:22.633884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:22.634333 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:22.634957 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:22.766325 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:22.775045 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bb5441d9-3adc-46ed-89cc-29d4bdb3e91b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.154055 Sep 09 20:31:22.775608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 216/448] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:22 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:23.283888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:23.285193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:23.292235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:23.292717 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:23.293155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:23.293877 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:23.294329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:23.294751 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:23.358463 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:23.366436 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6aad9d26-956f-4cac-9545-e053b0b4c383 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1210 microversion: 2.1 time: 0.086980 Sep 09 20:31:23.367144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 233/449] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:23 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:23.439998 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:23.440560 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:23.447113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:23.447590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:23.448022 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:23.448703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:23.449155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:23.449650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:23.576314 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:23.585361 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:23.586802 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:23.587948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-35e6e692-b176-41c8-bbec-45d6056a111f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.151921 Sep 09 20:31:23.588501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 217/450] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:23 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:23.804649 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:23.805266 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:23.811173 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:23.811652 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:23.812082 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:23.812762 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:23.813211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:23.813653 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:23.955315 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:23.964885 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eaf8fc0a-9317-488e-839e-c3da194d61a4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.163958 Sep 09 20:31:23.965567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 234/451] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:23 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:24.389043 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:24.389802 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:24.395884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.396493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.397632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:24.398221 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.398668 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.399085 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:24.465303 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:24.476050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c86f1fb8-8e1e-4108-9f20-a69d85c8b695 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1274 microversion: 2.1 time: 0.090123 Sep 09 20:31:24.476641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 218/452] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:24 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:24.613159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:24.614041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:24.620898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.621411 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.621843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:24.622517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.622963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.623375 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:24.757273 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:24.767510 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:24.768972 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:24.770167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7844a14-dbcc-44f2-bbbf-fdd213bc7b32 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.160938 Sep 09 20:31:24.770793 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 235/453] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:24 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:24.942765 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:24.943431 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:24.949381 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.949873 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.950303 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:24.951310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.951743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.952165 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:24.988808 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:24.989739 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:24.995770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.996495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.997049 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:24.997870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:24.998382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:24.998865 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:25.136669 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:25.148038 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50f8b62a-74de-4a40-91d5-25fd052ebb7c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1595 microversion: 2.1 time: 0.208991 Sep 09 20:31:25.149312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 219/454] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:24 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1595 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:25.177376 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:25.186700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b436b1fa-aadb-4716-b879-fbc042fc0a11 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.201058 Sep 09 20:31:25.201269 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 236/455] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:24 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:25.499493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:25.500203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:25.507414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:25.508198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:25.508836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:25.509771 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:25.510292 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:25.510941 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:25.734427 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:25.743649 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22f7746f-b995-4d6f-b6bb-0e8dd9b5e10c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1314 microversion: 2.1 time: 0.248529 Sep 09 20:31:25.745866 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 220/456] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:25 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:25.797547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:25.800309 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:25.810010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:25.813045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:25.814008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:25.814889 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:25.815342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:25.815761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:25.996060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:26.008042 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:26.010654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:26.012638 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-50fda219-99a1-4bba-91cc-68441d2d5e39 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.219042 Sep 09 20:31:26.013571 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 237/457] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:25 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:31:26.090716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-24599033-9d68-4180-9fd6-b110b25e5d35 req-2ff6c308-f1fd-4b40-bd10-17564fb20f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60da5619-5a72-4ef3-a73d-76b93e0979a8", "tag": "a600d7a7-b066-4b94-8540-14ea6430e0f4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:26.103727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-24599033-9d68-4180-9fd6-b110b25e5d35 req-2ff6c308-f1fd-4b40-bd10-17564fb20f7b service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:26.104205 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-24599033-9d68-4180-9fd6-b110b25e5d35 req-2ff6c308-f1fd-4b40-bd10-17564fb20f7b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:26.104625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-24599033-9d68-4180-9fd6-b110b25e5d35 req-2ff6c308-f1fd-4b40-bd10-17564fb20f7b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:26.117006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-24599033-9d68-4180-9fd6-b110b25e5d35 req-2ff6c308-f1fd-4b40-bd10-17564fb20f7b service nova] Creating event network-changed:a600d7a7-b066-4b94-8540-14ea6430e0f4 for instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 on hv-cinder-84932 Sep 09 20:31:26.122564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-24599033-9d68-4180-9fd6-b110b25e5d35 req-2ff6c308-f1fd-4b40-bd10-17564fb20f7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035563 Sep 09 20:31:26.123730 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 221/458] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:26.213054 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:26.213831 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:26.219962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:26.220750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:26.221300 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:26.222095 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:26.222698 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:26.223348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:26.465946 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:26.473718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7555aeb-84cd-48e0-95f1-f6b64b2a7c3e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.265006 Sep 09 20:31:26.474287 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 238/459] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:26 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:26.768492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:26.771133 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:26.778036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:26.778511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:26.779120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:26.779972 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:26.780867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:26.781312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:27.034139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:27.039985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:27.040829 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:27.043029 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1e2efc68-9011-4775-8ae1-dcae13c822eb tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1314 microversion: 2.1 time: 0.279510 Sep 09 20:31:27.043891 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 222/460] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:26 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:27.047523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:27.048009 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:27.048442 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:27.049133 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:27.049612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:27.050061 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:27.266131 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:27.277865 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:27.280550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5061479d-a733-4f8d-94a9-63e1714d933a req-b1eae1e9-2ffa-4844-b892-266303f490cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe125d2-51c7-4732-aa2a-90ab2d85d05f", "name": "network-vif-plugged", "status": "completed", "tag": "715458c7-e2c5-47e3-9ee4-1e82cbf7d53e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:27.280733 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:27.282217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-beff658f-1bb5-436e-97f0-09a693015ab4 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.246744 Sep 09 20:31:27.282935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 239/461] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:27 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:27.305656 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5061479d-a733-4f8d-94a9-63e1714d933a req-b1eae1e9-2ffa-4844-b892-266303f490cb service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:27.306410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5061479d-a733-4f8d-94a9-63e1714d933a req-b1eae1e9-2ffa-4844-b892-266303f490cb service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:27.306994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5061479d-a733-4f8d-94a9-63e1714d933a req-b1eae1e9-2ffa-4844-b892-266303f490cb service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:27.318252 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5061479d-a733-4f8d-94a9-63e1714d933a req-b1eae1e9-2ffa-4844-b892-266303f490cb service nova] Creating event network-vif-plugged:715458c7-e2c5-47e3-9ee4-1e82cbf7d53e for instance abe125d2-51c7-4732-aa2a-90ab2d85d05f on hv-cinder-84932 Sep 09 20:31:27.323982 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5061479d-a733-4f8d-94a9-63e1714d933a req-b1eae1e9-2ffa-4844-b892-266303f490cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057435 Sep 09 20:31:27.324577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 223/462] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:27.427522 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c1df6824-44ba-49cf-8391-8d56aefd44a5 req-3076969f-bd51-4e90-af7b-45a9432763f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5303a6-d80f-4a4f-831b-4432191724db", "tag": "b9b51f9a-0a54-4a10-bce6-3b821e125c22"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:27.437519 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c1df6824-44ba-49cf-8391-8d56aefd44a5 req-3076969f-bd51-4e90-af7b-45a9432763f7 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:27.438271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c1df6824-44ba-49cf-8391-8d56aefd44a5 req-3076969f-bd51-4e90-af7b-45a9432763f7 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:27.438934 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c1df6824-44ba-49cf-8391-8d56aefd44a5 req-3076969f-bd51-4e90-af7b-45a9432763f7 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:27.452085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c1df6824-44ba-49cf-8391-8d56aefd44a5 req-3076969f-bd51-4e90-af7b-45a9432763f7 service nova] Creating event network-changed:b9b51f9a-0a54-4a10-bce6-3b821e125c22 for instance 7a5303a6-d80f-4a4f-831b-4432191724db on hv-cinder-84932 Sep 09 20:31:27.457570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c1df6824-44ba-49cf-8391-8d56aefd44a5 req-3076969f-bd51-4e90-af7b-45a9432763f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033625 Sep 09 20:31:27.458172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 240/463] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:27.498879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:27.499643 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:27.506977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:27.507700 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:27.508088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:27.508809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:27.509305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:27.509724 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:27.671316 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:27.681134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9bfe9bc9-a7bd-44a0-a8cd-6a15047d39d3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.186981 Sep 09 20:31:27.685971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 224/464] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:27 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:28.066854 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:28.067728 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:28.075170 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:28.076197 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:28.104135 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:28.105068 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:28.105606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:28.107312 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:28.107916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:28.108493 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:28.310290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:28.310900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:28.317144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:28.320589 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:28.321308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:28.322098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:28.323034 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:28.323715 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:28.324292 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:28.727228 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:28.736731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-039fba68-4c82-4355-80e4-53cb198cbb4e tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1314 microversion: 2.1 time: 0.674985 Sep 09 20:31:28.751400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 241/465] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:28 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:28.751400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:28.751400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:28.755017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:28.755577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:28.756661 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:28.757720 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:28.758307 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:28.758816 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:28.843912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:28.857932 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:28.859550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:28.860725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-819b180d-1611-4c91-8280-840c2d0e41aa tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.555308 Sep 09 20:31:28.861311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 225/466] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:28 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:31:28.915426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:28.924132 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-94324cab-306f-41b5-84da-7106e917c640 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.184994 Sep 09 20:31:28.924880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 242/467] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:28 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:29.199510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-367478277"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:29.200075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:29.206025 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:29.206510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:29.207098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:29.207788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:29.208243 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:29.208661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:29.340787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Adding security group bb88d1f2-da15-4fd6-a24f-a84abab0e6ae to port b9b51f9a-0a54-4a10-bce6-3b821e125c22 Sep 09 20:31:29.706954 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-85a93379-98c0-4dea-9e5b-eb10e66efe9c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/action" status: 202 len: 0 microversion: 2.1 time: 0.511045 Sep 09 20:31:29.708411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 226/468] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:31:29 2022] POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:31:29.716126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:29.717431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:29.724091 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:29.725205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:29.725934 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:29.726871 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:29.727523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:29.728162 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:29.739391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5db6e31d-a607-4edf-9943-cfd9adb7787b req-45f424cb-de6b-4fd7-bc21-5a67f34302d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5303a6-d80f-4a4f-831b-4432191724db", "tag": "b9b51f9a-0a54-4a10-bce6-3b821e125c22"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:29.760632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5db6e31d-a607-4edf-9943-cfd9adb7787b req-45f424cb-de6b-4fd7-bc21-5a67f34302d4 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:29.761530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5db6e31d-a607-4edf-9943-cfd9adb7787b req-45f424cb-de6b-4fd7-bc21-5a67f34302d4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:29.762201 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5db6e31d-a607-4edf-9943-cfd9adb7787b req-45f424cb-de6b-4fd7-bc21-5a67f34302d4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:29.783526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5db6e31d-a607-4edf-9943-cfd9adb7787b req-45f424cb-de6b-4fd7-bc21-5a67f34302d4 service nova] Creating event network-changed:b9b51f9a-0a54-4a10-bce6-3b821e125c22 for instance 7a5303a6-d80f-4a4f-831b-4432191724db on hv-cinder-84932 Sep 09 20:31:29.795011 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5db6e31d-a607-4edf-9943-cfd9adb7787b req-45f424cb-de6b-4fd7-bc21-5a67f34302d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059365 Sep 09 20:31:29.797190 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 227/469] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:29.809765 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:29.810960 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:29.828033 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:29.829155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:29.830395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:29.832196 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:29.832859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:29.833555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:30.015394 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:30.029982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8902c2ed-c71a-4aa2-8f7f-15f45ddf05db tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1641 microversion: 2.1 time: 0.317469 Sep 09 20:31:30.031743 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 243/470] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:29 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1641 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:30.039939 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:30.041817 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:30.047717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:30.051063 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:30.051991 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:30.052532 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:30.053913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:30.054945 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:30.055475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:30.061620 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4dee36a1-bbf6-482b-af22-9b24539049fe tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1314 microversion: 2.1 time: 0.261859 Sep 09 20:31:30.062450 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 228/471] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:29 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:30.076970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=100 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:30.083148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:30.083800 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:30.090229 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:30.090715 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:30.091156 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:30.091854 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:30.092300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:30.092711 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:30.286791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:30.291573 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:30.300165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:30.301885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5fba5c46-b38d-4a1a-a00f-deb6b40d87c2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.227254 Sep 09 20:31:30.302485 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:30.303559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 229/472] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:30 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:30.317905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e973e46-fc89-436e-a630-a645a5d47463 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1811 microversion: 2.20 time: 0.271480 Sep 09 20:31:30.317905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 244/473] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:30 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1811 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:31.090496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:31.091157 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:31.097582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:31.098062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:31.098496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:31.099181 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:31.099635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:31.100055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:31.229193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:31.237133 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f92d9f81-ad3a-47c2-82bb-b373bc3a1290 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1314 microversion: 2.1 time: 0.150910 Sep 09 20:31:31.237745 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 245/474] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:31 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:31.301733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cada41dc-b786-4b9a-ade9-ffe2b2de4827 req-629f27b9-c8de-42d8-b2a3-45971459b64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60da5619-5a72-4ef3-a73d-76b93e0979a8", "name": "network-vif-plugged", "status": "completed", "tag": "a600d7a7-b066-4b94-8540-14ea6430e0f4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:31.307366 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:31.313876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cada41dc-b786-4b9a-ade9-ffe2b2de4827 req-629f27b9-c8de-42d8-b2a3-45971459b64d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:31.314489 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cada41dc-b786-4b9a-ade9-ffe2b2de4827 req-629f27b9-c8de-42d8-b2a3-45971459b64d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:31.315004 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cada41dc-b786-4b9a-ade9-ffe2b2de4827 req-629f27b9-c8de-42d8-b2a3-45971459b64d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:31.327996 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cada41dc-b786-4b9a-ade9-ffe2b2de4827 req-629f27b9-c8de-42d8-b2a3-45971459b64d service nova] Creating event network-vif-plugged:a600d7a7-b066-4b94-8540-14ea6430e0f4 for instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 on hv-cinder-84932 Sep 09 20:31:31.329458 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:31.330131 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:31.333055 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cada41dc-b786-4b9a-ade9-ffe2b2de4827 req-629f27b9-c8de-42d8-b2a3-45971459b64d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Sep 09 20:31:31.333400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:31.334393 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 230/475] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:31.339799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:31.340247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:31.340868 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:31.341087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:31.341467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:31.342785 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:31.343197 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:31.344279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:31.347585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:31.348155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:31.349063 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:31.349524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:31.351046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:31.351046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:31.560355 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:31.570122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:31.571352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:31.571771 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:31.573016 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-690e9c4f-335e-4ebf-962c-cd8f38580d8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1798 microversion: 2.20 time: 0.237652 Sep 09 20:31:31.573682 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 231/476] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:31:31 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1798 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:31:31.580781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb1008ce-0353-4bd6-ae63-107a3e48fa91 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.256922 Sep 09 20:31:31.581475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 246/477] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:31 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:32.259207 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:32.259813 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:32.265909 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:32.266382 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:32.266814 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:32.267490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:32.267940 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:32.268357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:32.272888 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=100 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:32.394889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:32.402983 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0bcb9c82-9117-441e-aa89-eef682b4c3f7 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1314 microversion: 2.1 time: 0.147706 Sep 09 20:31:32.403539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 232/478] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:32 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:32.604196 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:32.604725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:32.611448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:32.611929 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:32.612364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:32.613044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:32.613772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:32.614196 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:32.747537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:32.755183 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e789a1a-c40f-4692-bdc9-ecbe3a0bee1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1676 microversion: 2.1 time: 0.154940 Sep 09 20:31:32.756276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 247/479] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:32 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:33.425604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:33.426202 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:33.433188 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.433698 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.434136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.434820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.435279 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.435703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.567913 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:33.575975 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b2db13cd-0055-4571-b32f-0579485a27ee tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1464 microversion: 2.1 time: 0.154183 Sep 09 20:31:33.576726 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 233/480] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:33 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:33.633302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:33.633827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:33.640121 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.640602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.641039 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.641754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.642206 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.642630 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.668254 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:31:33.741355 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bf81723c-4dec-43ef-9a3f-c8013c888d39 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 204 len: 0 microversion: 2.1 time: 0.111640 Sep 09 20:31:33.742115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 248/481] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:31:33 2022] DELETE /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:31:33.751364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:33.751971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:33.757829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.758307 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.758738 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.759422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.759873 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.760293 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.778800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:33.779491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:33.785388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.785866 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.786315 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.787722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.789396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.789825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:33.957731 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:33.961514 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:33.965781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0028bfb2-dd35-4d66-ac74-b8acf27e2f8c tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1470 microversion: 2.1 time: 0.219294 Sep 09 20:31:33.966433 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 234/482] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:33 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:33.969194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42cfcc50-c574-4a5e-978d-617ddc44b136 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1653 microversion: 2.1 time: 0.194640 Sep 09 20:31:33.969774 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 249/483] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:33 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1653 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:33.992059 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7032edb0-bf63-469d-b2c4-f9f32828cd73 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:33.997989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7032edb0-bf63-469d-b2c4-f9f32828cd73 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:33.998272 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7032edb0-bf63-469d-b2c4-f9f32828cd73 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:33.998764 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7032edb0-bf63-469d-b2c4-f9f32828cd73 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:34.020800 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7032edb0-bf63-469d-b2c4-f9f32828cd73 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Going to try to start instance {{(pid=120680) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 20:31:34.061359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7032edb0-bf63-469d-b2c4-f9f32828cd73 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action" status: 202 len: 0 microversion: 2.1 time: 0.073675 Sep 09 20:31:34.061942 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 235/484] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:31:33 2022] POST /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:31:34.070023 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:34.070646 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:34.076443 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:34.076916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:34.077377 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:34.078052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:34.078490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:34.078905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:34.206528 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:34.214758 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0dff6d6-91b7-4798-9ca7-2c86bf252237 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1662 microversion: 2.1 time: 0.148562 Sep 09 20:31:34.215317 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 250/485] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:34 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:34.990690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:34.991388 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:34.998111 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:34.998592 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:34.999028 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:34.999713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:35.000166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:35.000589 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:35.130039 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:35.138241 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5c611196-9553-4a56-b846-792bbe109110 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1470 microversion: 2.1 time: 0.152631 Sep 09 20:31:35.138904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 236/486] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:34 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:35.237707 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:35.238578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:35.245101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:35.245619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:35.246049 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:35.246913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:35.247370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:35.247786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:35.380637 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:35.389055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-037161ea-8e62-4ae2-9aa2-2d6e7eb2cf97 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1662 microversion: 2.1 time: 0.155192 Sep 09 20:31:35.389661 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 251/487] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:35 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:35.952645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-37c5d1e8-c102-4138-90c4-4f10e6679692 req-6d409116-e3a5-4259-9476-48bb35e84ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60da5619-5a72-4ef3-a73d-76b93e0979a8", "name": "network-vif-deleted", "tag": "a600d7a7-b066-4b94-8540-14ea6430e0f4"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:35.963322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-37c5d1e8-c102-4138-90c4-4f10e6679692 req-6d409116-e3a5-4259-9476-48bb35e84ff4 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:35.963989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-37c5d1e8-c102-4138-90c4-4f10e6679692 req-6d409116-e3a5-4259-9476-48bb35e84ff4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:35.964487 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-37c5d1e8-c102-4138-90c4-4f10e6679692 req-6d409116-e3a5-4259-9476-48bb35e84ff4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:35.977677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-37c5d1e8-c102-4138-90c4-4f10e6679692 req-6d409116-e3a5-4259-9476-48bb35e84ff4 service nova] Creating event network-vif-deleted:a600d7a7-b066-4b94-8540-14ea6430e0f4 for instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 on hv-cinder-84932 Sep 09 20:31:35.983347 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-37c5d1e8-c102-4138-90c4-4f10e6679692 req-6d409116-e3a5-4259-9476-48bb35e84ff4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036149 Sep 09 20:31:35.984025 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 237/488] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:36.161624 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:36.162238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:36.168201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:36.168677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:36.169118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:36.169835 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:36.170279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:36.170698 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:36.201559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:36.202040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:36.202473 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:36.202905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lazy-loading 'fault' on Instance uuid 60da5619-5a72-4ef3-a73d-76b93e0979a8 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:31:36.249544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:36.257514 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7bc01dcd-a8e3-4ba4-9ad3-d2c5a544156d tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1304 microversion: 2.1 time: 0.099679 Sep 09 20:31:36.258084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 252/489] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:36 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:36.412833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:36.413553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:36.419759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:36.420237 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:36.420672 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:36.421378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:36.421832 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:36.422256 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:36.558574 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:36.566195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77210cb7-5496-4bdb-9b55-7ad1834ffee8 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1662 microversion: 2.1 time: 0.158082 Sep 09 20:31:36.566756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 238/490] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:36 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:37.279899 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:37.280543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:37.287202 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:37.287820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:37.288338 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:37.289086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:37.289632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:37.290123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:37.325524 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:37.326085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:37.326529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:37.327045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lazy-loading 'fault' on Instance uuid 60da5619-5a72-4ef3-a73d-76b93e0979a8 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:31:37.372067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ea21f089fa47b38fc6e9835a72ede8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f672a6f47c84495986796b8814900b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:37.379024 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c8717551-4db6-4c8c-873a-3b658316dcc1 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 200 len: 1304 microversion: 2.1 time: 0.102992 Sep 09 20:31:37.379592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 253/491] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:37 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:37.590075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:37.590687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:37.597339 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:37.597821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:37.598255 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:37.598934 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:37.599961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:37.600383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:37.730358 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:37.737886 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f8b21ed-fdb0-4567-a723-2344889bf4a1 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1666 microversion: 2.1 time: 0.151636 Sep 09 20:31:37.738701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 239/492] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:37 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:38.402418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:38.403028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] [instance: 60da5619-5a72-4ef3-a73d-76b93e0979a8] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:38.409558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:38.410039 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:38.410476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:38.411158 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:38.411610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:38.412031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:38.425041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] HTTP exception thrown: Instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 could not be found. Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Request method failure captured: Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 HTTP/1.1 Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6KT-nh8R6pgv9tJyz-rLGLz8S3_VMWC-tl5wKfrjscmL0tzfeDc1EJIsTNgdwy7v79AK5iOQM580NbxEMSD-DyXh3QxFSH2Y-QV3bUlPicQSsyFr16j0h-3s9Z_ctW2qhFUqjFG1gjSYtgunka4wFJXQbaDZS66_YxxjIT1eJy1tXs Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 2f672a6f47c84495986796b8814900b2 Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-VolumesNegativeTest-935371583 Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:31:38.426678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2f672a6f47c84495986796b8814900b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f672a6f47c84495986796b8814900b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2f672a6f47c84495986796b8814900b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2f672a6f47c84495986796b8814900b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-VolumesNegativeTest-935371583 Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 2f672a6f47c84495986796b8814900b2 Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-VolumesNegativeTest-935371583 Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-VolumesNegativeTest-935371583-project Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: a6ea21f089fa47b38fc6e9835a72ede8 Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-VolumesNegativeTest-935371583-project Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 could not be found. Sep 09 20:31:38.428925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '60da5619-5a72-4ef3-a73d-76b93e0979a8'} Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 could not be found. Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:31:38.429840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 could not be found. Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 could not be found. Sep 09 20:31:38.431346 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:31:38.432610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] Returning 404 to user: Instance 60da5619-5a72-4ef3-a73d-76b93e0979a8 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:31:38.432610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ad50a0c6-cc06-4960-a77f-cf0e1c2ad7e5 tempest-VolumesNegativeTest-935371583 tempest-VolumesNegativeTest-935371583-project] 10.222.0.26 "GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8" status: 404 len: 111 microversion: 2.1 time: 0.030131 Sep 09 20:31:38.432610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 254/493] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:38 2022] GET /compute/v2.1/servers/60da5619-5a72-4ef3-a73d-76b93e0979a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:31:49.382098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a245529-5724-4482-b97a-5b8b6a3af8de"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:49.384539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:49.387288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=19 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:49.387961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:49.393570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:49.394048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:49.394478 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:49.395161 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:49.395673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:49.396100 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:49.631076 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a23933c0-e57c-4f9c-bf54-8bc61a6fc9a0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253447 Sep 09 20:31:49.631714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 240/494] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:31:49 2022] POST /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:31:52.835517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:52.837843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:52.840454 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:52.841237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:31:52.848075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:52.848663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:52.849081 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:52.849800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:52.850253 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:52.850676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:52.920955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-57b87fea-eb94-43d3-8785-f0cce673e2f8 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/action" status: 202 len: 0 microversion: 2.1 time: 0.089608 Sep 09 20:31:52.921527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 255/495] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:31:52 2022] POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:31:52.930723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:52.931419 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:52.937814 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:52.938280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:52.938712 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:52.939601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:52.939844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:52.940263 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:53.083319 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:53.091961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dab79fae-0729-4823-9f19-3b1dd20a9e15 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1752 microversion: 2.1 time: 0.166078 Sep 09 20:31:53.092813 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 241/496] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:52 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:54.117621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:54.118341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:54.124509 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:54.124934 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:54.125396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:54.126086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:54.126539 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:54.126964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:54.267427 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:54.275592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fd54fd4b-fb89-4cac-bae1-00d537abf96f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.163526 Sep 09 20:31:54.276141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 256/497] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:54 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:55.298729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:55.299340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:55.305823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:55.306308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:55.306743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:55.307429 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:55.307880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:55.308307 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:55.460230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:55.468439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f75df83-b3fa-4e9d-9ae5-7a620a02e0fe tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.173588 Sep 09 20:31:55.469003 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 242/498] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:55 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:56.491625 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:56.492269 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:56.498716 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:56.499191 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:56.499623 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:56.500311 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:56.500763 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:56.501189 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:56.639540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:56.648354 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-156f18e0-3bbc-4c56-bca4-1c944837738a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.160933 Sep 09 20:31:56.648913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 257/499] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:56 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:57.162371 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:31:57.164614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:57.170926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:57.171396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:57.171826 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:57.172497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:57.172940 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:57.173382 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:57.196311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lazy-loading 'flavor' on Instance uuid 41051093-877e-41db-a9b9-d2c2624a3314 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:31:57.318082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6d313331-2476-440f-b789-a408c7c89505 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/action" status: 200 len: 32 microversion: 2.1 time: 0.159045 Sep 09 20:31:57.318887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 243/500] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:31:57 2022] POST /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:31:57.328378 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:57.328980 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:57.335551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:57.336041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:57.336484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:57.337171 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:57.337659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:57.338111 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:57.479975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:57.488669 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5a5bb18b-c289-464a-a27f-9582458bf72b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.164131 Sep 09 20:31:57.490816 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 258/501] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:57 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:31:57.672392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:57.673200 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:57.679707 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:57.680186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:57.680613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:57.681327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:57.681775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:57.682191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:57.826047 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:57.834860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4c25a5ac-b861-4b0d-bbec-29be7e3eb3ba tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.166894 Sep 09 20:31:57.835438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 244/502] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:57 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:58.511879 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:58.512492 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:58.518906 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:58.519385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:58.519824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:58.521028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:58.521508 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:58.521930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:58.649667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:58.657843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-163329fc-c54d-4fba-b620-7882c4fea606 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.149770 Sep 09 20:31:58.658347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 259/503] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:58 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:58.858663 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:58.859192 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:58.866563 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:58.867037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:58.867464 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:58.868141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:58.868581 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:58.868992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:59.006886 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:59.014977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf668d0d-f7a7-4272-89eb-737af30f2b7f tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.160376 Sep 09 20:31:59.015535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 245/504] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:58 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:31:59.681834 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:31:59.682442 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:31:59.688835 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:59.689347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:59.689780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:59.690458 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:31:59.690910 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:31:59.691331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:31:59.815589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:31:59.824160 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c62d630d-d8f5-4ab6-a9e4-04d0679f336a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.146180 Sep 09 20:31:59.824732 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 260/505] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:31:59 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:00.038351 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:00.038958 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:00.045504 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:00.045982 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:00.046413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:00.047093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:00.047542 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:00.047983 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:00.190280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:00.198537 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-812d0198-e5e2-4795-94a6-2f532f8300e2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.164597 Sep 09 20:32:00.199104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 246/506] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:00 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:00.849878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:00.850770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:00.858454 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:00.859094 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:00.859632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:00.860458 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:00.861062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:00.861547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:00.987509 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:00.995854 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-395be9e3-9258-453b-a6dd-aec5c07acad6 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.151524 Sep 09 20:32:00.996423 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 261/507] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:00 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:01.221126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:01.221792 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:01.228647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:01.229123 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:01.229602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:01.230285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:01.230736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:01.231175 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:01.371141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:01.379219 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f0c913d9-a635-4c30-bb84-8a0f67ceafb6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.161951 Sep 09 20:32:01.380326 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 247/508] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:01 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:02.018520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:02.019265 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:02.025800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:02.026283 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:02.026718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:02.027401 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:02.027849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:02.028268 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:02.154278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:02.163210 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be7184f7-0caa-491e-a06a-03dd65427d20 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.148551 Sep 09 20:32:02.163770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 262/509] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:02 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:02.402809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:02.403334 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:02.409854 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:02.410341 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:02.411380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:02.412069 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:02.412526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:02.412951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:02.553003 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:02.561138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22c9a7f9-df5b-4abe-a7c5-46d11ac29766 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.162307 Sep 09 20:32:02.561734 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 248/510] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:02 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:03.186061 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:03.186733 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:03.193706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:03.194179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:03.194605 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:03.195279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:03.195721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:03.196138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:03.327005 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:03.335866 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-df46459b-3ad4-4a29-a36d-e9f919974c94 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.153680 Sep 09 20:32:03.336661 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 263/511] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:03 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:03.585339 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:03.585874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:03.592473 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:03.592994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:03.593535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:03.594217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:03.594744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:03.595220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:03.735557 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:03.744467 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-89138330-9acb-4f3e-ab55-7f9752273a27 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.163693 Sep 09 20:32:03.745027 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 249/512] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:03 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:04.358612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:04.359223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:04.366383 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:04.366855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:04.367279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:04.367951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:04.368394 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:04.368807 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:04.500474 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:04.509195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6d54417-9d16-4667-b9d1-e25168348fd7 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.154402 Sep 09 20:32:04.509771 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 264/513] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:04 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:04.767872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:04.768509 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:04.774916 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:04.775392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:04.775823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:04.776499 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:04.776949 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:04.777421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:04.920246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:04.929126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-aa19e3f3-aa7c-40ce-8b26-06e3fa6d7112 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.164977 Sep 09 20:32:04.929973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 250/514] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:04 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:05.532480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:05.533061 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:05.540078 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:05.540553 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:05.540981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:05.541691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:05.542142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:05.542553 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:05.678970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:05.687240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62e502a4-66c6-484a-8a11-33c63a2d1613 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.158707 Sep 09 20:32:05.687804 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 265/515] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:05 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:05.952013 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:05.952548 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:05.961398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:05.961968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:05.962407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:05.963137 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:05.963559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:05.963983 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:06.105599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:06.114219 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-642681b9-6106-49ea-a06a-ea2aa41b0108 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.166157 Sep 09 20:32:06.114784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 251/516] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:05 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:06.711239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:06.711899 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:06.718244 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:06.718725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:06.719156 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:06.719837 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:06.720399 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:06.720822 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:06.851534 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:06.859642 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-42042552-2d75-47e0-873c-866089b3041f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.152272 Sep 09 20:32:06.860216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 266/517] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:06 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:07.137328 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:07.138193 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:07.144604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:07.145668 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:07.146097 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:07.146773 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:07.147240 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:07.147655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:07.285837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:07.293926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8d3a0cec-83ba-41ff-a8de-c3485c82730c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.160542 Sep 09 20:32:07.294487 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 252/518] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:07 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:07.883730 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:07.884321 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:07.890741 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:07.891223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:07.891657 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:07.892337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:07.892788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:07.893211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:08.018104 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:08.026672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-839eef1d-15d4-41ce-91e8-fcb589e078cd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.147307 Sep 09 20:32:08.027228 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 267/519] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:07 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:08.319546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:08.320161 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:08.326971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:08.327745 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:08.328182 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:08.328903 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:08.329382 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:08.329799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:08.334107 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:08.475165 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:08.483326 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8df50d64-3dd3-49d2-8841-b40b63b886d2 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.170269 Sep 09 20:32:08.483886 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 253/520] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:08 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:09.049380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:09.049986 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:09.056295 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:09.056770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:09.057199 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:09.057897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:09.058343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:09.058756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:09.193920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:09.202121 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1d385879-5d3e-41fb-bf5e-001e5ea016fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.156585 Sep 09 20:32:09.202629 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 268/521] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:09 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:09.506983 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:09.507595 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:09.514026 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:09.514513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:09.514950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:09.515667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:09.516126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:09.516550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:09.671803 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:09.680638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-afb24e65-e204-4ec8-8413-380a6f35fc42 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1757 microversion: 2.1 time: 0.178019 Sep 09 20:32:09.681211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 254/522] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:09 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:10.226312 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:10.226913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:10.233206 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:10.233710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:10.234137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:10.234816 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:10.235264 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:10.235675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:10.360558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:10.369407 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-daea4003-f71a-4865-81d7-8246bf20089b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.147460 Sep 09 20:32:10.369966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 269/523] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:10 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:10.703753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:10.704365 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:10.711465 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:10.711943 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:10.712372 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:10.713049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:10.713524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:10.713947 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:10.851522 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:10.860160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cd595d60-451d-454d-86d8-30596a041900 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1760 microversion: 2.1 time: 0.160190 Sep 09 20:32:10.861249 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 255/524] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:10 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:11.391888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:11.392468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:11.399388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:11.399867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:11.400294 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:11.400970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:11.401445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:11.401860 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:11.421446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:11.534602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:11.543201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-58c8e5e7-29b9-445e-92fb-aeb4eadaf178 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1736 microversion: 2.1 time: 0.155176 Sep 09 20:32:11.543761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 270/525] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:11 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:12.566918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:12.567526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:12.573661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.574143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.574579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.575260 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.575711 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.576132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.657226 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:12.657796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:12.664444 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.664920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.665381 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.666059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.666563 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.666974 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.697476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e848eb07-e4b1-4c24-830a-cd23d7ea5479 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments/1b55a10b-ab94-43b7-8634-927d1d5b1ccf" status: 200 len: 194 microversion: 2.20 time: 0.044931 Sep 09 20:32:12.697992 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 271/526] 10.222.0.26 () {60 vars in 1454 bytes} [Fri Sep 9 20:32:12 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments/1b55a10b-ab94-43b7-8634-927d1d5b1ccf => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:32:12.705194 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:12.713790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a659251-7855-4d8e-98ab-f6ac0ef86114 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1716 microversion: 2.1 time: 0.151311 Sep 09 20:32:12.714362 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 256/527] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:12 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:12.767202 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:12.767806 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:12.773592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.774055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.774489 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.775161 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.775603 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.776014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.824251 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:12.824871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:12.830836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.831406 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.832545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.833317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.833845 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.834468 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.856838 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lazy-loading 'services' on Instance uuid abe125d2-51c7-4732-aa2a-90ab2d85d05f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:32:12.929159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-135d5307-caab-48ba-89fc-82ba92a07872 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments/1b55a10b-ab94-43b7-8634-927d1d5b1ccf" status: 202 len: 0 microversion: 2.20 time: 0.165715 Sep 09 20:32:12.929799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 272/528] 10.222.0.26 () {60 vars in 1457 bytes} [Fri Sep 9 20:32:12 2022] DELETE /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments/1b55a10b-ab94-43b7-8634-927d1d5b1ccf => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:32:12.938481 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:12.940969 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:12.947639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.948076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.948495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.949190 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.949677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.950093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.968667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] HTTP exception thrown: Cannot 'detach_volume' instance 41051093-877e-41db-a9b9-d2c2624a3314 while it is in vm_state rescued Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Request method failure captured: Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments/5a245529-5724-4482-b97a-5b8b6a3af8de HTTP/1.1 Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HiCOFZyuZ-ZTyWWLYgPe2Fl0u1RCs41Ue4gboYqbaAz9wKDooOGtWDJ0T5oZUyuL_oKMxGPSr25tvsKPqIJRJmt1_AcZ0WBVpWGm669vz3jv4XQdsbKybbhUvmaawpaQ9K7lypMpIGWpy2q2X_uBd_LiiE2b9xoECuB-UE7EFF45M Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:32:12.970612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f07defd609684351b4b7d0d110212a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: a95746e7a84541199b43138b1a348386 Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:32:12.972233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Cannot 'detach_volume' instance 41051093-877e-41db-a9b9-d2c2624a3314 while it is in vm_state rescued Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'server_id': '41051093-877e-41db-a9b9-d2c2624a3314', 'id': '5a245529-5724-4482-b97a-5b8b6a3af8de'} Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 41051093-877e-41db-a9b9-d2c2624a3314 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:32:12.973638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 41051093-877e-41db-a9b9-d2c2624a3314 while it is in vm_state rescued Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 41051093-877e-41db-a9b9-d2c2624a3314 while it is in vm_state rescued Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:12.975398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Returning 409 to user: Cannot 'detach_volume' instance 41051093-877e-41db-a9b9-d2c2624a3314 while it is in vm_state rescued {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:32:12.976588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1efc3ed8-d2d1-4a5d-880a-7eaaa015e002 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "DELETE /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments/5a245529-5724-4482-b97a-5b8b6a3af8de" status: 409 len: 152 microversion: 2.1 time: 0.152169 Sep 09 20:32:12.976588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 257/529] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:32:12 2022] DELETE /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments/5a245529-5724-4482-b97a-5b8b6a3af8de => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 09 20:32:12.982268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:12.982798 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:12.986305 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7ff3d381-16f9-4487-b59f-37b491e1cef5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051615 Sep 09 20:32:12.986573 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 273/530] 10.222.0.26 () {60 vars in 1343 bytes} [Fri Sep 9 20:32:12 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:32:12.994439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.995487 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.996280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:12.997606 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:12.997837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:12.998264 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:13.066940 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1b88cc55-f2f6-4a83-bb3f-0063adbef63f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "POST /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/action" status: 202 len: 0 microversion: 2.1 time: 0.088147 Sep 09 20:32:13.067555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 258/531] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:32:12 2022] POST /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:32:13.075791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:13.076427 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:13.083226 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:13.083700 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:13.084130 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:13.084811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:13.085267 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:13.085694 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:13.217809 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:13.225922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b5a8fd3-6c36-467e-8457-d72db67070c9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1724 microversion: 2.1 time: 0.153933 Sep 09 20:32:13.226485 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 274/532] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:13 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:14.000214 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:14.002731 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:14.008747 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.009217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.009675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.010353 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.010795 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.011206 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.039735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f7f294ad-4b00-44e2-b7ef-908af143b200 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044415 Sep 09 20:32:14.040267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 259/533] 10.222.0.26 () {60 vars in 1343 bytes} [Fri Sep 9 20:32:13 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:14.102109 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:14.102620 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:14.109017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.109540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.109975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.110666 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.111119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.111846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.136458 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:32:14.209396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29935862-ea4a-44a8-a2e6-50aa7df4987b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 204 len: 0 microversion: 2.20 time: 0.111657 Sep 09 20:32:14.209958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 275/534] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Sep 9 20:32:14 2022] DELETE /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 20:32:14.218093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:14.218693 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:14.225020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.225521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.225962 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.226645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.227096 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.227516 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.250066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:14.250756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:14.257552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.258066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.258523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.259213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:14.259662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:14.260084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:14.404851 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:14.414085 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:14.415516 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:14.416714 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-92f3e7c1-7d73-4cfa-8b88-4a25ef463274 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.202543 Sep 09 20:32:14.417284 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 260/535] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:14 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:14.430774 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:14.438825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-033613f9-cc7b-4a64-ba21-d54e90455a31 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1724 microversion: 2.1 time: 0.192962 Sep 09 20:32:14.439382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 276/536] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:14 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:15.442144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:15.442748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:15.449212 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:15.449722 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:15.450157 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:15.450842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:15.451294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:15.451720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:15.461663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:15.462293 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:15.468667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:15.469137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:15.469617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:15.470300 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:15.470756 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:15.471177 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:15.649833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:15.652716 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:15.658961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:15.661183 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ed380fed-fca3-4ee6-87d5-f3c66e239d8b tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1724 microversion: 2.1 time: 0.203321 Sep 09 20:32:15.661479 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:15.661807 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 277/537] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:15 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:15.663023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-824f7b58-070e-4804-adcd-9f36a11f14c5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.224873 Sep 09 20:32:15.663562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 261/538] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:15 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:16.645289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:16.647425 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:16.653306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.653787 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.654222 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.654902 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.655356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.655779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.683742 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:16.684378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:16.685197 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c917c194-d3bb-468b-8038-bf7bb665365a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044472 Sep 09 20:32:16.685781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 278/539] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:32:16 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:32:16.691144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.691770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.692286 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.692424 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:16.693029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:16.693691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.694144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.694793 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.702544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.703030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.703469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.704162 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.704632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.705031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.902963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:16.907110 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:16.911120 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:16.912549 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:16.913723 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9177f8c4-b158-49c4-a105-3d534ad130fe tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.225061 Sep 09 20:32:16.914481 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 279/540] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:16 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:16.915835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-65e61ed9-8567-4f96-8833-17bc31937f65 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1724 microversion: 2.1 time: 0.235829 Sep 09 20:32:16.919576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:16.920240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:16.923415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 262/541] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:16 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:16.926712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.927314 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.927847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.928744 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:16.929327 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:16.929864 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:16.955138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:32:17.028785 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6e37de5a-8d78-427a-bb60-2d4fa014756d tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 204 len: 0 microversion: 2.1 time: 0.112530 Sep 09 20:32:17.029388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 280/542] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:32:16 2022] DELETE /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:32:17.037754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:17.038443 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:17.044259 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:17.044734 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:17.045167 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:17.045872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:17.046344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:17.046745 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:17.174675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:17.182874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04f9e923-6287-4088-a58c-946a75dc90f3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1672 microversion: 2.1 time: 0.149051 Sep 09 20:32:17.183430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 263/543] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:17 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:17.938725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:17.939379 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:17.939748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:17.939846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:17.946438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:17.946572 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:17.946918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:17.947031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:17.947348 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:17.947464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:17.948034 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:17.948153 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:17.948481 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:17.948597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:17.948897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:17.949003 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:18.139095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:18.142566 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:18.147387 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:18.148921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:18.150191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c6dfdb6-9a34-4281-a9fb-a4c4e2e73c98 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.215556 Sep 09 20:32:18.150766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-37280708-7b31-4f14-afcf-af33ba34cef3 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1730 microversion: 2.1 time: 0.216060 Sep 09 20:32:18.150927 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 264/544] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:17 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:32:18.151325 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 281/545] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:17 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:18.172209 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:18.172691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:18.179087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:18.179560 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:18.179989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:18.180665 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:18.181110 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:18.181557 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:18.205864 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:18.206394 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:18.212469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:18.212959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:18.213437 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:18.214136 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:18.214590 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:18.215017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:18.267536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d266baec-eb13-4236-81d6-f2357897cb6a tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098786 Sep 09 20:32:18.268130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 265/546] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:32:18 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:18.350914 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:18.358551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f8756e63-d486-4d3a-9470-39afad910e29 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1672 microversion: 2.1 time: 0.156462 Sep 09 20:32:18.359114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 282/547] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:18 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:19.176359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:19.177166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:19.183680 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:19.184290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:19.184721 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:19.185439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:19.185885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:19.186318 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:19.326290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:19.334886 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:19.336343 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:19.337577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f077b8f1-c30b-4fe1-825b-0f5a3019daac tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1726 microversion: 2.20 time: 0.166117 Sep 09 20:32:19.338135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 266/548] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:19 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:19.383542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:19.384369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:19.391123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:19.391603 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:19.392032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:19.392722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:19.393167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:19.393610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:19.397876 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:19.527029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:19.535467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27cb257b-b0b9-49f8-922e-3f019c87066f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1672 microversion: 2.1 time: 0.155912 Sep 09 20:32:19.536031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 283/549] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:19 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:20.022330 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-8db3827c-feba-4b62-b747-d780cb3a8cd3 req-02375e9e-7283-4e0a-93aa-ec13c36c11b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41051093-877e-41db-a9b9-d2c2624a3314", "tag": "21f730a2-1ecb-4742-8ea6-973064a729fc"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:20.027643 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=55 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:20.033227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8db3827c-feba-4b62-b747-d780cb3a8cd3 req-02375e9e-7283-4e0a-93aa-ec13c36c11b9 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:20.033722 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8db3827c-feba-4b62-b747-d780cb3a8cd3 req-02375e9e-7283-4e0a-93aa-ec13c36c11b9 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:20.034139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-8db3827c-feba-4b62-b747-d780cb3a8cd3 req-02375e9e-7283-4e0a-93aa-ec13c36c11b9 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:20.046763 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-8db3827c-feba-4b62-b747-d780cb3a8cd3 req-02375e9e-7283-4e0a-93aa-ec13c36c11b9 service nova] Creating event network-changed:21f730a2-1ecb-4742-8ea6-973064a729fc for instance 41051093-877e-41db-a9b9-d2c2624a3314 on hv-cinder-84932 Sep 09 20:32:20.053107 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-8db3827c-feba-4b62-b747-d780cb3a8cd3 req-02375e9e-7283-4e0a-93aa-ec13c36c11b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033930 Sep 09 20:32:20.053762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 267/550] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:20.369522 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:20.370203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:20.379561 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:20.379938 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:20.380464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:20.381556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:20.382212 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:20.382827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:20.475065 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:20.493564 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:20.497630 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:20.499398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-efc973a6-4bfd-44ce-9f1d-2c3d596bf23d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1658 microversion: 2.20 time: 0.138641 Sep 09 20:32:20.501494 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 284/551] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:20 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1658 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:20.562690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:20.563488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:20.570701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:20.571584 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:20.572083 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:20.572856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:20.573394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:20.574050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:20.696042 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:20.706665 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f5cc4a9-eb47-45da-b8c7-489cf377f544 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1606 microversion: 2.1 time: 0.151541 Sep 09 20:32:20.727722 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 268/552] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:20 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1606 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:21.528414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:21.529699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:21.536392 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:21.537113 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:21.538016 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:21.538638 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:21.539249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:21.539677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:21.576938 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:21.577471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:21.577950 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:21.578367 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lazy-loading 'fault' on Instance uuid abe125d2-51c7-4732-aa2a-90ab2d85d05f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:32:21.629845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:21.640598 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:21.643083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:21.645395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d6d31da8-8ec9-4cbb-9871-ee6106778a09 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 200 len: 1372 microversion: 2.20 time: 0.120758 Sep 09 20:32:21.646943 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 285/553] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:21 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 1372 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:21.732272 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:21.733306 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:21.747899 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:21.753705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:21.755498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:21.758186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:21.758670 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:21.759097 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:21.827492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:21.828228 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:21.828949 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:21.829926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lazy-loading 'fault' on Instance uuid 7e0ef033-9a7a-4b4d-8c77-2e52b202adec {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:32:21.836933 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:21.881006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:21.889879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1397fdf3-b0be-4a8a-b5f7-e4f9c60eb6ef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 200 len: 1328 microversion: 2.1 time: 0.162409 Sep 09 20:32:21.890719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 269/554] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:21 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 1328 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:22.078342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41051093-877e-41db-a9b9-d2c2624a3314", "tag": "21f730a2-1ecb-4742-8ea6-973064a729fc"}, {"server_uuid": "abe125d2-51c7-4732-aa2a-90ab2d85d05f", "name": "network-vif-deleted", "tag": "715458c7-e2c5-47e3-9ee4-1e82cbf7d53e"}, {"server_uuid": "7e0ef033-9a7a-4b4d-8c77-2e52b202adec", "name": "network-vif-deleted", "tag": "b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:22.093873 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:22.094353 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:22.094803 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:22.111079 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] Creating event network-changed:21f730a2-1ecb-4742-8ea6-973064a729fc for instance 41051093-877e-41db-a9b9-d2c2624a3314 on hv-cinder-84932 Sep 09 20:32:22.111859 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] Creating event network-vif-deleted:715458c7-e2c5-47e3-9ee4-1e82cbf7d53e for instance abe125d2-51c7-4732-aa2a-90ab2d85d05f on hv-cinder-84932 Sep 09 20:32:22.113464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] Creating event network-vif-deleted:b62ecdb1-c015-4d82-aa4c-02ed3cd73c8a for instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec on hv-cinder-84932 Sep 09 20:32:22.125550 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-5965506d-e9b0-4e90-805b-6bf7c72a0645 req-448f07c7-ed41-40d3-8e40-a623a55cc5f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.055284 Sep 09 20:32:22.126163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 286/555] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:32:22.678647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:22.679453 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:22.685972 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:22.686739 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:22.687237 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:22.688031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:22.688540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:22.689076 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:22.703110 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] HTTP exception thrown: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Request method failure captured: Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f HTTP/1.1 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HhtVvkR70a10IL4zVlC1rpu2TU6xWtEjv9xSzpj437gWdEI3u8ex2Mle8Yk9jr1KghHJJyFqMSwiPxJNjQKIGppF8AlcW46MD6RwrDNIwv_lScZncvLIf7pEmeJsAzMTejZyhR4I7VJnPuMmJXtNGWdPCwo_8yB9j3fI8CV3AJsI8 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:32:22.704880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: db1f365ebf794941b3999adb37c48100 Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:32:22.706513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'abe125d2-51c7-4732-aa2a-90ab2d85d05f'} Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:32:22.707375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:32:22.708673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.709848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Returning 404 to user: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:32:22.709848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b7fd8f79-0499-4166-80a9-226514af780b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 404 len: 111 microversion: 2.20 time: 0.032110 Sep 09 20:32:22.709848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 270/556] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:22 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 20:32:22.719574 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b547d1d8-a105-4c19-86cd-f7fddbef1179 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '.version_select at 0x7f48349685e0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:22.741958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b547d1d8-a105-4c19-86cd-f7fddbef1179 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742328126" status: 204 len: 0 microversion: 2.20 time: 0.027102 Sep 09 20:32:22.742523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 287/557] 10.222.0.26 () {60 vars in 1262 bytes} [Fri Sep 9 20:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1742328126 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 20:32:22.917109 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:22.918539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:22.932790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:22.934338 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:22.935430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:22.936683 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:22.937536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:22.938174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:22.960607 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] HTTP exception thrown: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Request method failure captured: Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec HTTP/1.1 Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HayXe9FnQ3-Xd62JpzW7BxAg1hi5j_CJEOcR7I8r6Jc601vxkg4n9ZBdD7QfFzuP9uhRnTGNS5k9ArRcPbK1YNtFfavm883F_LC9lNp4i9Y9aqVEry_jivRI1hVjS6EV58qezFYWpR2lKCBWnFTSmxwNekfRtLmRZNYVuJwPTmL1k Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:32:22.962696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 95bc48b6541c4388b45435036a1c4525 Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:32:22.964050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '7e0ef033-9a7a-4b4d-8c77-2e52b202adec'} Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:32:22.964835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:32:22.966117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:32:22.969981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Returning 404 to user: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:32:22.971226 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c781db3-63d1-4c29-8441-ff9ba415ad06 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 404 len: 111 microversion: 2.1 time: 0.060884 Sep 09 20:32:22.976072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 271/558] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:22 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:32:22.981529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-103f529b-787f-4a68-aa58-9fc12bb797be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '.version_select at 0x7f4834957d30>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:22.991084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:23.010587 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-103f529b-787f-4a68-aa58-9fc12bb797be tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909536023" status: 202 len: 0 microversion: 2.1 time: 0.032943 Sep 09 20:32:23.011844 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 288/559] 10.222.0.26 () {58 vars in 1221 bytes} [Fri Sep 9 20:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909536023 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 20:32:23.839400 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8211402f-cf9f-407b-8d6c-2bb52bfce5f9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'create', calling method: .version_select at 0x7f4834d419d0>, body: {"keypair": {"name": "tempest-keypair-229528076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW74isgPulQPeN4C+l1Hj/xslePwcbiuN++KMCQTE6xu3sastjFbgNgKkFnJ8jBo06XO43JVV0x4fF6RGGzJeMJpzpmlk0tK1brIRz2YpSsg1AfHrRgsv0OuHxGRhYRyw=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:23.862773 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-8211402f-cf9f-407b-8d6c-2bb52bfce5f9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for project 8c1c909559e44322a07f7e4a463424a5. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:32:23.867387 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-8211402f-cf9f-407b-8d6c-2bb52bfce5f9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for user db1f365ebf794941b3999adb37c48100 and project 8c1c909559e44322a07f7e4a463424a5. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:32:23.907444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8211402f-cf9f-407b-8d6c-2bb52bfce5f9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.072277 Sep 09 20:32:23.908235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 272/560] 10.222.0.26 () {62 vars in 1200 bytes} [Fri Sep 9 20:32:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 20:32:24.107731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ccd92b19-cc5a-4856-998f-099b1b24e3d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'create', calling method: .version_select at 0x7f48349edee0>, body: {"keypair": {"name": "tempest-keypair-1838623671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFsmq5b5+9JztUkfqdXQ0PSGZCU4EYB69ro2W3YFA+DGid/LQBY2C3J02YMWvRmOeWqeW4RRhyMH8wGlwuaPVzHSh8UGIZQCXQdaRMumgkKbMbcaiyYch675Gt/I3udvA=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:24.123469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-ccd92b19-cc5a-4856-998f-099b1b24e3d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for project b310c05b03394f11b63f0a28f13d67b6. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:32:24.127178 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-ccd92b19-cc5a-4856-998f-099b1b24e3d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for user 95bc48b6541c4388b45435036a1c4525 and project b310c05b03394f11b63f0a28f13d67b6. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:32:24.150035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ccd92b19-cc5a-4856-998f-099b1b24e3d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047325 Sep 09 20:32:24.151403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 289/561] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:32:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:25.252866 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2100177418", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e922e249-8412-4a6f-a000-86403046577e"}], "security_groups": [{"name": "tempest-securitygroup--1931587015"}], "key_name": "tempest-keypair-229528076", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:25.413727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] validate_networks() for [('e922e249-8412-4a6f-a000-86403046577e', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:32:25.513125 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1742448108", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f13a2180-b7d4-4447-b571-f0f2b37395e2"}], "security_groups": [{"name": "tempest-securitygroup--299090174"}], "key_name": "tempest-keypair-1838623671", "user_data": "}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:25.687054 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] validate_networks() for [('f13a2180-b7d4-4447-b571-f0f2b37395e2', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:32:25.942205 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:32:25.942647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:32:25.943128 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:32:25.943523 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:32:25.943920 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:32:25.952493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:25.952944 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:25.953482 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:25.954184 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:25.954625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:25.955036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:25.975076 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for project 8c1c909559e44322a07f7e4a463424a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:32:25.979013 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Getting quotas for user db1f365ebf794941b3999adb37c48100 and project 8c1c909559e44322a07f7e4a463424a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:32:25.990095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:32:25.992373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:32:26.039859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-795d78f4-71c0-422d-bc3b-9085ece3173c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.792051 Sep 09 20:32:26.040501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 273/562] 10.222.0.26 () {62 vars in 1188 bytes} [Fri Sep 9 20:32:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 20:32:26.051511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c5bf3d37-4d3d-434b-8cc3-431f325334b0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:26.052116 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c5bf3d37-4d3d-434b-8cc3-431f325334b0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:26.142472 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5bf3d37-4d3d-434b-8cc3-431f325334b0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:26.150435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5bf3d37-4d3d-434b-8cc3-431f325334b0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:26.151892 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c5bf3d37-4d3d-434b-8cc3-431f325334b0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:26.152998 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c5bf3d37-4d3d-434b-8cc3-431f325334b0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1281 microversion: 2.20 time: 0.105387 Sep 09 20:32:26.153747 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 274/563] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:26 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:32:26.191543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:32:26.191923 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:32:26.192384 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:32:26.192786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:32:26.193195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:32:26.206378 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:26.206863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:26.207327 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:26.208076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:26.208530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:26.209000 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:26.225392 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for project b310c05b03394f11b63f0a28f13d67b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:32:26.229363 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Getting quotas for user 95bc48b6541c4388b45435036a1c4525 and project b310c05b03394f11b63f0a28f13d67b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:32:26.241834 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:32:26.244355 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:32:26.290594 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ec03be9-e2cc-4f8c-8fe3-3f41c1679930 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.782299 Sep 09 20:32:26.291244 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 290/564] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:32:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 20:32:26.302764 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-26e2469f-e44c-45e0-94f7-746830065e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:26.303364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-26e2469f-e44c-45e0-94f7-746830065e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:26.363626 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-26e2469f-e44c-45e0-94f7-746830065e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:26.371141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-26e2469f-e44c-45e0-94f7-746830065e8f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1238 microversion: 2.1 time: 0.072653 Sep 09 20:32:26.371716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 275/565] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:26 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:27.178617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:27.179875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:27.187285 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:27.187773 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:27.188705 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:27.189440 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:27.190054 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:27.190320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:27.255754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:27.265880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:27.267612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:27.269006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-44e72fa6-7934-4b81-abd9-2407dea41a52 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1341 microversion: 2.20 time: 0.095422 Sep 09 20:32:27.269612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 291/566] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:27 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:27.394316 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:27.395511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:27.403369 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:27.403970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:27.404410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:27.405109 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:27.405585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:27.406073 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:27.467968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:27.476042 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2af7a956-dc17-4e6d-b203-60ec384c2869 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1290 microversion: 2.1 time: 0.086170 Sep 09 20:32:27.476604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 276/567] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:27 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:28.296662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:28.297403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:28.303788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:28.304277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:28.304711 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:28.305722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:28.312661 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:28.320460 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:28.454529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:28.463660 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:28.465681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:28.466952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-120e2b5a-95bb-41cc-ae88-60bfc7249f5b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.174267 Sep 09 20:32:28.468011 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 292/568] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:28 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:28.499807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:28.500593 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:28.507687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:28.508175 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:28.508613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:28.509335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:28.509794 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:28.510328 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:28.572424 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:28.580174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b3655b8d-dc9c-4ee6-a287-d4949c721452 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1296 microversion: 2.1 time: 0.084383 Sep 09 20:32:28.580749 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 277/569] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:28 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:29.356995 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0307f743-3fb8-46b6-82f2-78bf9901944e req-0ae367cc-7078-497b-8c7a-86e0b1ddad3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85693f6-363f-443c-a6db-0db004b654ae", "tag": "dc8afa85-2831-4191-870d-42e15a736429"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:29.369501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0307f743-3fb8-46b6-82f2-78bf9901944e req-0ae367cc-7078-497b-8c7a-86e0b1ddad3e service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:29.370246 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0307f743-3fb8-46b6-82f2-78bf9901944e req-0ae367cc-7078-497b-8c7a-86e0b1ddad3e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:29.370842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0307f743-3fb8-46b6-82f2-78bf9901944e req-0ae367cc-7078-497b-8c7a-86e0b1ddad3e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:29.385606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0307f743-3fb8-46b6-82f2-78bf9901944e req-0ae367cc-7078-497b-8c7a-86e0b1ddad3e service nova] Creating event network-changed:dc8afa85-2831-4191-870d-42e15a736429 for instance e85693f6-363f-443c-a6db-0db004b654ae on hv-cinder-84932 Sep 09 20:32:29.393108 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0307f743-3fb8-46b6-82f2-78bf9901944e req-0ae367cc-7078-497b-8c7a-86e0b1ddad3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039549 Sep 09 20:32:29.394094 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 293/570] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:32:29.492297 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:29.492903 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:29.498915 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:29.499391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:29.499825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:29.500640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:29.501986 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:29.502442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:29.604703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:29.605631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:29.612180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:29.613593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:29.614096 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:29.614863 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:29.615358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:29.615779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:29.636095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:29.644636 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:29.646125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:29.647241 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b44fc03e-3892-45ca-af9d-eac407257ba1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.158904 Sep 09 20:32:29.647968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 278/571] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:29 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:29.751271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:29.759022 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-452c479f-dbf5-4145-8abb-e2b5ff30f056 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.158733 Sep 09 20:32:29.759589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 294/572] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:29 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:30.673805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:30.674417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:30.680897 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:30.681422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:30.681864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:30.682550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:30.683003 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:30.683428 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:30.781061 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:30.781802 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:30.788763 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:30.789351 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:30.789854 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:30.790550 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:30.791001 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:30.791422 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:30.809287 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:30.817602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:30.819111 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:30.820210 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96fe4537-8196-48e1-bce5-216a895f7859 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.150358 Sep 09 20:32:30.820775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 279/573] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:30 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:30.926684 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:30.934402 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-93787ca5-b4f7-4b6a-856a-04f3dfdaa66f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.157073 Sep 09 20:32:30.934974 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 295/574] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:30 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:31.424252 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-94148970-d226-47fc-8e8b-691d34e435e0 req-96efddde-975a-4a96-b942-40ca5b6964e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e208f300-e8f3-44d5-9b42-27b8815e811f", "tag": "0ae3bddd-935a-4674-81de-0492ee6b5ef0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:31.434440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-94148970-d226-47fc-8e8b-691d34e435e0 req-96efddde-975a-4a96-b942-40ca5b6964e9 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:31.434907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-94148970-d226-47fc-8e8b-691d34e435e0 req-96efddde-975a-4a96-b942-40ca5b6964e9 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:31.435329 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-94148970-d226-47fc-8e8b-691d34e435e0 req-96efddde-975a-4a96-b942-40ca5b6964e9 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:31.446708 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-94148970-d226-47fc-8e8b-691d34e435e0 req-96efddde-975a-4a96-b942-40ca5b6964e9 service nova] Creating event network-changed:0ae3bddd-935a-4674-81de-0492ee6b5ef0 for instance e208f300-e8f3-44d5-9b42-27b8815e811f on hv-cinder-84932 Sep 09 20:32:31.451584 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-94148970-d226-47fc-8e8b-691d34e435e0 req-96efddde-975a-4a96-b942-40ca5b6964e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030920 Sep 09 20:32:31.452227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 280/575] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:31.845463 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:31.846058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:31.852650 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:31.853127 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:31.853589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:31.854266 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:31.854707 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:31.855113 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:31.962305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:31.963120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:31.972299 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:31.972793 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:31.973225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:31.974003 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:31.974460 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:31.974887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:31.987216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:31.996166 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:31.997725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:31.998905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5f84e6e3-d4a2-4c6e-b400-ec479ec4c7ef tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.157543 Sep 09 20:32:31.999547 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 296/576] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:31 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:32.104774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:32.112589 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-897bae52-367e-4fd1-abab-506715ea9ea4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.159180 Sep 09 20:32:32.113134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 281/577] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:31 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:33.023232 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:33.023983 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:33.030632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:33.031098 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:33.031537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:33.032239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:33.032691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:33.033111 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:33.134951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:33.136537 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:33.143961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:33.144440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:33.145039 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:33.145753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:33.146322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:33.147148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:33.166249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:33.174704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:33.176226 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:33.177287 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e3f45bf-82d3-4e5c-80af-e1eb0787e608 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.158432 Sep 09 20:32:33.178043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 297/578] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:33 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:33.284082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:33.293112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a79aa789-9112-4b8a-ae55-684722960bb4 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.162107 Sep 09 20:32:33.293657 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 282/579] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:33 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:34.201881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:34.202418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:34.209431 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:34.209910 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:34.210337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:34.211013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:34.211466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:34.211883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:34.316033 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:34.316634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:34.322957 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:34.323430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:34.323857 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:34.324535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:34.324976 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:34.325417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:34.341322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:34.349819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:34.351260 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:34.352393 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc76845f-a233-42b6-8be7-2ed32394ca3b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.154502 Sep 09 20:32:34.353146 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 298/580] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:34 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:34.459543 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:34.467192 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-449cbf4d-a823-4b11-8180-a6c5f9018dff tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.155443 Sep 09 20:32:34.467757 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 283/581] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:34 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:35.377672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:35.378843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:35.385193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:35.385704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:35.386135 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:35.386812 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:35.387262 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:35.387678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:35.490357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:35.490882 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:35.497171 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:35.497690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:35.498121 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:35.498809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:35.499253 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:35.499667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:35.517648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:35.525867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:35.527323 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:35.528426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-de9c1586-b3c3-4269-b2c7-f873625c9683 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.154681 Sep 09 20:32:35.529182 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 299/582] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:35 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:35.624703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:35.632852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68fa0415-b001-4a43-b594-c939946bb653 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.147253 Sep 09 20:32:35.633440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 284/583] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:35 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:35.887859 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-45c879c2-f977-40e4-80b3-b74a28dee296 req-a7487c8e-3d6f-4564-835a-66c9745a6a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85693f6-363f-443c-a6db-0db004b654ae", "name": "network-vif-plugged", "status": "completed", "tag": "dc8afa85-2831-4191-870d-42e15a736429"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:35.898924 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-45c879c2-f977-40e4-80b3-b74a28dee296 req-a7487c8e-3d6f-4564-835a-66c9745a6a2b service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:35.899418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-45c879c2-f977-40e4-80b3-b74a28dee296 req-a7487c8e-3d6f-4564-835a-66c9745a6a2b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:35.899835 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-45c879c2-f977-40e4-80b3-b74a28dee296 req-a7487c8e-3d6f-4564-835a-66c9745a6a2b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:35.911246 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-45c879c2-f977-40e4-80b3-b74a28dee296 req-a7487c8e-3d6f-4564-835a-66c9745a6a2b service nova] Creating event network-vif-plugged:dc8afa85-2831-4191-870d-42e15a736429 for instance e85693f6-363f-443c-a6db-0db004b654ae on hv-cinder-84932 Sep 09 20:32:35.916118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-45c879c2-f977-40e4-80b3-b74a28dee296 req-a7487c8e-3d6f-4564-835a-66c9745a6a2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031993 Sep 09 20:32:35.916903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 300/584] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:36.553695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:36.554327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:36.556292 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:36.556972 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=14 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:36.563075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:36.563558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:36.563988 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:36.564675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:36.565125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:36.566103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:36.656232 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:36.656935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:36.659174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:36.659835 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=10 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:36.666613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:36.667099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:36.667531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:36.668230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:36.668675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:36.669310 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:36.697977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:36.706053 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:36.707495 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:36.708594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7693ca39-09a1-4765-a502-65a579585cb9 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.158888 Sep 09 20:32:36.709148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 285/585] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:36 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:36.803035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:36.810506 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0350ea06-6704-40f6-96c3-093feea01f1a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.158852 Sep 09 20:32:36.811061 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 301/586] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:36 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:37.734099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:37.734708 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:37.741412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:37.741974 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:37.742508 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:37.743199 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:37.743640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:37.744053 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:37.833141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:37.834861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:37.843537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:37.844030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:37.844467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:37.845143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:37.846034 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:37.846628 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:37.880860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:37.888973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:37.890422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:37.891524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8d3dea81-6db4-42aa-8e21-3ddaeb21006a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1407 microversion: 2.20 time: 0.161757 Sep 09 20:32:37.892085 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 286/587] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:37 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:37.935745 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-0a8d9b90-1966-4aaf-b98f-8fbe7714227f req-76dc606f-7864-4152-92f0-a446f91b0776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e208f300-e8f3-44d5-9b42-27b8815e811f", "name": "network-vif-plugged", "status": "completed", "tag": "0ae3bddd-935a-4674-81de-0492ee6b5ef0"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:37.945570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a8d9b90-1966-4aaf-b98f-8fbe7714227f req-76dc606f-7864-4152-92f0-a446f91b0776 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:37.946071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a8d9b90-1966-4aaf-b98f-8fbe7714227f req-76dc606f-7864-4152-92f0-a446f91b0776 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:37.946496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-0a8d9b90-1966-4aaf-b98f-8fbe7714227f req-76dc606f-7864-4152-92f0-a446f91b0776 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:37.957778 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-0a8d9b90-1966-4aaf-b98f-8fbe7714227f req-76dc606f-7864-4152-92f0-a446f91b0776 service nova] Creating event network-vif-plugged:0ae3bddd-935a-4674-81de-0492ee6b5ef0 for instance e208f300-e8f3-44d5-9b42-27b8815e811f on hv-cinder-84932 Sep 09 20:32:37.962927 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-0a8d9b90-1966-4aaf-b98f-8fbe7714227f req-76dc606f-7864-4152-92f0-a446f91b0776 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030672 Sep 09 20:32:37.963566 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 287/588] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:32:37.982833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:37.990750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f12252b0-560c-4dd7-823f-7062dcc04dd7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.162209 Sep 09 20:32:37.991326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 302/589] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:37 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:38.917436 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:38.918127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:38.924226 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:38.924712 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:38.925144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:38.925848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:38.926319 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:38.926720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:39.014203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:39.014896 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:39.021905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:39.022472 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:39.022973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:39.023731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:39.024192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:39.024613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:39.055087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:39.063511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:39.064952 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:39.066130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48dfa559-a858-486b-9a7a-ac18510a419f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1600 microversion: 2.20 time: 0.153466 Sep 09 20:32:39.066685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 288/590] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:32:38 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:32:39.090338 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:39.090826 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:39.097288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:39.097772 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:39.098207 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:39.098897 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:39.099347 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:39.099768 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:39.189395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:39.195869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3618fb24-f426-443f-be89-9040b2a7e11d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109241 Sep 09 20:32:39.196478 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 289/591] 10.222.0.26 () {60 vars in 1316 bytes} [Fri Sep 9 20:32:39 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:32:39.199983 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3cff71f5-938b-4306-a2b9-5951f71bdc5c tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1363 microversion: 2.1 time: 0.189521 Sep 09 20:32:39.200567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 303/592] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:39 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:32:40.223591 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:40.224202 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:40.230387 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:40.230871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:40.231310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:40.232011 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:40.232463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:40.232885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:40.414083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-d9330d35-eb3b-4626-b3db-fdb7d3936d8d req-5c929b09-f71c-432e-b122-22cbeafab6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85693f6-363f-443c-a6db-0db004b654ae", "tag": "dc8afa85-2831-4191-870d-42e15a736429"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:40.425075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d9330d35-eb3b-4626-b3db-fdb7d3936d8d req-5c929b09-f71c-432e-b122-22cbeafab6af service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:40.425705 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d9330d35-eb3b-4626-b3db-fdb7d3936d8d req-5c929b09-f71c-432e-b122-22cbeafab6af service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:40.426234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-d9330d35-eb3b-4626-b3db-fdb7d3936d8d req-5c929b09-f71c-432e-b122-22cbeafab6af service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:40.427072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:40.435149 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8d3fe6ad-f40a-4ea1-9d31-910aa2abf301 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1550 microversion: 2.1 time: 0.216016 Sep 09 20:32:40.435928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 290/593] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:40 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1550 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:40.437851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-d9330d35-eb3b-4626-b3db-fdb7d3936d8d req-5c929b09-f71c-432e-b122-22cbeafab6af service nova] Creating event network-changed:dc8afa85-2831-4191-870d-42e15a736429 for instance e85693f6-363f-443c-a6db-0db004b654ae on hv-cinder-84932 Sep 09 20:32:40.442879 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-d9330d35-eb3b-4626-b3db-fdb7d3936d8d req-5c929b09-f71c-432e-b122-22cbeafab6af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032553 Sep 09 20:32:40.443542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 304/594] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:40.457988 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:40.458526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:40.464800 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:40.465089 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:40.465825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:40.466252 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:40.466705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:40.467125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:40.553431 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86d17210-fcaa-46a4-80cc-c17655e035d7 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099810 Sep 09 20:32:40.554212 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 291/595] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:32:40 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:42.459118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-03a3c6b8-4eb8-4370-84ed-3aea55500ea5 req-65c21616-9321-4ffe-aead-520d92fb347e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e208f300-e8f3-44d5-9b42-27b8815e811f", "tag": "0ae3bddd-935a-4674-81de-0492ee6b5ef0"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:42.470364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-03a3c6b8-4eb8-4370-84ed-3aea55500ea5 req-65c21616-9321-4ffe-aead-520d92fb347e service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:42.470867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-03a3c6b8-4eb8-4370-84ed-3aea55500ea5 req-65c21616-9321-4ffe-aead-520d92fb347e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:42.471361 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-03a3c6b8-4eb8-4370-84ed-3aea55500ea5 req-65c21616-9321-4ffe-aead-520d92fb347e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:42.482743 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-03a3c6b8-4eb8-4370-84ed-3aea55500ea5 req-65c21616-9321-4ffe-aead-520d92fb347e service nova] Creating event network-changed:0ae3bddd-935a-4674-81de-0492ee6b5ef0 for instance e208f300-e8f3-44d5-9b42-27b8815e811f on hv-cinder-84932 Sep 09 20:32:42.488200 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-03a3c6b8-4eb8-4370-84ed-3aea55500ea5 req-65c21616-9321-4ffe-aead-520d92fb347e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033592 Sep 09 20:32:42.488794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 305/596] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:50.739028 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:50.739770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=92 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:50.744146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-367478277"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:50.744668 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:50.751743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:50.752266 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:50.752692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:50.753406 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:50.753851 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:50.754264 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:50.881545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.network.security_group_api [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Removing security group bb88d1f2-da15-4fd6-a24f-a84abab0e6ae from port b9b51f9a-0a54-4a10-bce6-3b821e125c22 Sep 09 20:32:51.183720 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-939b275f-132b-4525-885a-0949bdd417c7 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/action" status: 202 len: 0 microversion: 2.1 time: 0.447255 Sep 09 20:32:51.184328 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 292/597] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:32:50 2022] POST /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:32:51.193147 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-6b8fb8f9-9060-40bd-9d83-2727c02bba66 req-238f75d8-8de9-4267-a08f-6b5119c21a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5303a6-d80f-4a4f-831b-4432191724db", "tag": "b9b51f9a-0a54-4a10-bce6-3b821e125c22"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:51.203066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6b8fb8f9-9060-40bd-9d83-2727c02bba66 req-238f75d8-8de9-4267-a08f-6b5119c21a14 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:51.203548 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6b8fb8f9-9060-40bd-9d83-2727c02bba66 req-238f75d8-8de9-4267-a08f-6b5119c21a14 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:51.203975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-6b8fb8f9-9060-40bd-9d83-2727c02bba66 req-238f75d8-8de9-4267-a08f-6b5119c21a14 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:51.208459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=97 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:51.216763 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-6b8fb8f9-9060-40bd-9d83-2727c02bba66 req-238f75d8-8de9-4267-a08f-6b5119c21a14 service nova] Creating event network-changed:b9b51f9a-0a54-4a10-bce6-3b821e125c22 for instance 7a5303a6-d80f-4a4f-831b-4432191724db on hv-cinder-84932 Sep 09 20:32:51.222621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-6b8fb8f9-9060-40bd-9d83-2727c02bba66 req-238f75d8-8de9-4267-a08f-6b5119c21a14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034336 Sep 09 20:32:51.223769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 306/598] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:32:51.818913 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:51.819541 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:51.826859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:51.826859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:51.828806 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:51.829324 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:51.829808 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:51.834779 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:51.923305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lazy-loading 'services' on Instance uuid 41051093-877e-41db-a9b9-d2c2624a3314 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:32:52.049752 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-af35c004-3a92-4452-8827-423e4a4ff075 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "DELETE /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments/5a245529-5724-4482-b97a-5b8b6a3af8de" status: 202 len: 0 microversion: 2.1 time: 0.235416 Sep 09 20:32:52.054235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 293/599] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:32:51 2022] DELETE /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments/5a245529-5724-4482-b97a-5b8b6a3af8de => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:32:52.061888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:52.065454 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:52.074449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:52.075177 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:52.075905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:52.076977 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:52.077767 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:52.078351 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:52.112552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-00a54323-5d64-4c4e-95d2-265b83b41486 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056612 Sep 09 20:32:52.113156 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 307/600] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:32:52 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:32:52.422228 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:52.422817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:52.429580 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:52.430123 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:52.430564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:52.431312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:52.431767 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:52.432413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:52.513129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lazy-loading 'services' on Instance uuid 7a5303a6-d80f-4a4f-831b-4432191724db {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:32:52.587511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-68e293a5-7a18-4092-a1f8-9fe736f86934 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments/d483319f-8316-4976-b3ad-1b43e46d10af" status: 202 len: 0 microversion: 2.1 time: 0.169417 Sep 09 20:32:52.588357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 294/601] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:32:52 2022] DELETE /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments/d483319f-8316-4976-b3ad-1b43e46d10af => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:32:52.596625 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:52.599375 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:52.605860 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:52.606572 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:52.607192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:52.608059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:52.608667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:52.609291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:52.643855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e98f1e13-fa3b-4204-8103-491323ebad4c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051098 Sep 09 20:32:52.645060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 308/602] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:32:52 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:32:53.125784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:53.128336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:53.135143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:53.135553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:53.136031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:53.137030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:53.137990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:53.138505 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:53.170781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c729197-eb11-4a9a-9a90-f90a0b4531fd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050039 Sep 09 20:32:53.171264 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 295/603] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:32:53 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:53.239391 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2c524f2a-a76c-4809-960b-b19365b58a57 req-3e566fd4-bae2-4d79-a742-ff7773740137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5303a6-d80f-4a4f-831b-4432191724db", "tag": "b9b51f9a-0a54-4a10-bce6-3b821e125c22"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:32:53.248952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c524f2a-a76c-4809-960b-b19365b58a57 req-3e566fd4-bae2-4d79-a742-ff7773740137 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:53.249470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c524f2a-a76c-4809-960b-b19365b58a57 req-3e566fd4-bae2-4d79-a742-ff7773740137 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:53.249907 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2c524f2a-a76c-4809-960b-b19365b58a57 req-3e566fd4-bae2-4d79-a742-ff7773740137 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:53.261100 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2c524f2a-a76c-4809-960b-b19365b58a57 req-3e566fd4-bae2-4d79-a742-ff7773740137 service nova] Creating event network-changed:b9b51f9a-0a54-4a10-bce6-3b821e125c22 for instance 7a5303a6-d80f-4a4f-831b-4432191724db on hv-cinder-84932 Sep 09 20:32:53.266149 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2c524f2a-a76c-4809-960b-b19365b58a57 req-3e566fd4-bae2-4d79-a742-ff7773740137 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030729 Sep 09 20:32:53.266725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 309/604] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:32:53.657840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:53.660542 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:53.667636 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:53.668558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:53.669197 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:53.670144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:53.670804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:53.674524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:53.708110 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-55eead21-e38c-4c71-a811-c1beca435c9a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054219 Sep 09 20:32:53.709130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 296/605] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:32:53 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 20:32:53.720480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:53.721098 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:53.730555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:53.731556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:53.732476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:53.733888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:53.734646 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:53.735180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:53.815280 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] HTTP exception thrown: Instance 7a5303a6-d80f-4a4f-831b-4432191724db is not attached to volume d483319f-8316-4976-b3ad-1b43e46d10af Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Request method failure captured: Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments/d483319f-8316-4976-b3ad-1b43e46d10af HTTP/1.1 Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6JPjLMy34gVuQNJ82FSNmosgEtFyA8qakHdUIKqS4kJzmbWy_Tt9fIO3-_ni9tRdZgUusm82e9FmoW9wuAcFqoag_bI5rO98ANBHTjd8u4ofMnEiZpYhETPv8I0oqKDWcUFj8yGA4VAjQlsjjOlP1ClsQ0nwwGZKfII4qTDhcLDQKU Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: da5cdb6c865f4345be2de638e6ded3c6 Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-TestMinimumBasicScenario-1443625129 Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:32:53.825617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-TestMinimumBasicScenario-1443625129 Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: da5cdb6c865f4345be2de638e6ded3c6 Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1443625129 Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-TestMinimumBasicScenario-1443625129-project Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: ec90aaf1a60746f69e5478987ab86bc1 Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-TestMinimumBasicScenario-1443625129-project Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:32:53.827272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 7a5303a6-d80f-4a4f-831b-4432191724db is not attached to volume d483319f-8316-4976-b3ad-1b43e46d10af Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'server_id': '7a5303a6-d80f-4a4f-831b-4432191724db', 'id': 'd483319f-8316-4976-b3ad-1b43e46d10af'} Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d483319f-8316-4976-b3ad-1b43e46d10af. Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:32:53.828249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5303a6-d80f-4a4f-831b-4432191724db is not attached to volume d483319f-8316-4976-b3ad-1b43e46d10af Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5303a6-d80f-4a4f-831b-4432191724db is not attached to volume d483319f-8316-4976-b3ad-1b43e46d10af Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:32:53.829722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Returning 404 to user: Instance 7a5303a6-d80f-4a4f-831b-4432191724db is not attached to volume d483319f-8316-4976-b3ad-1b43e46d10af {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:32:53.831370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e11e7a65-00ac-4341-b15a-9da7e4a47f1d tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments/d483319f-8316-4976-b3ad-1b43e46d10af" status: 404 len: 154 microversion: 2.1 time: 0.110886 Sep 09 20:32:53.831370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 310/606] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:32:53 2022] DELETE /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db/os-volume_attachments/d483319f-8316-4976-b3ad-1b43e46d10af => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:32:54.182908 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:54.185046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:54.191392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.191876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.192315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:54.193000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.193488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.193915 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:54.222804 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cc1d1d57-00d7-444f-8ab5-e11555b5b5d0 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043917 Sep 09 20:32:54.223352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 297/607] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:32:54 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:32:54.297342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:54.297836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:54.299800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:32:54.305083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.305598 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.306141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:54.306726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.307185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.307611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:54.335578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:32:54.410454 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-06820b99-d73c-4809-b74b-ff8d27210694 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "DELETE /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 204 len: 0 microversion: 2.1 time: 0.116647 Sep 09 20:32:54.411060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 311/608] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:32:54 2022] DELETE /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:32:54.419447 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:54.420057 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:54.426705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.427183 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.427614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:54.428298 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.428746 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.429162 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:54.559550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:54.567801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fd870e7c-d29e-4052-b6cd-26cbda6ab392 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1690 microversion: 2.1 time: 0.152268 Sep 09 20:32:54.568370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 298/609] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:54 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:54.967920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:54.968517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:54.975415 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.975887 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.976311 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:54.976993 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:54.977469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:54.977886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:55.002468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:32:55.074610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8af71249-be1f-48d7-a71b-e4d90eff7622 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 204 len: 0 microversion: 2.1 time: 0.110629 Sep 09 20:32:55.075172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 312/610] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:32:54 2022] DELETE /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:32:55.083856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:55.084456 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:55.090351 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:55.090817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:55.091242 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:55.091915 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:55.092375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:55.092769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:55.230340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:55.238334 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad97a8cb-58d0-470e-a2be-b9a3e9b32eab tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1555 microversion: 2.1 time: 0.158930 Sep 09 20:32:55.238891 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 299/611] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:55 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:55.592038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:55.592649 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:55.598466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:55.598936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:55.599359 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:55.600059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:55.600503 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:55.600917 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:55.731435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:55.739805 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f7514687-ce77-4f4e-9117-0d0a1a748cca tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1690 microversion: 2.1 time: 0.152076 Sep 09 20:32:55.740362 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 313/612] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:55 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:56.260671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:56.261274 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:56.267655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:56.268131 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:56.268561 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:56.269235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:56.269709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:56.270125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:56.395339 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:56.402895 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f97649a-f7c8-4f5c-8794-248188d98700 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1555 microversion: 2.1 time: 0.146110 Sep 09 20:32:56.403458 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 300/613] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:56 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:56.762245 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:56.762852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:56.769197 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:56.769716 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:56.770149 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:56.770829 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:56.771279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:56.771701 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:56.905395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:56.913509 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-564545fe-d1f0-4a5b-8a2e-636731255755 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1690 microversion: 2.1 time: 0.155132 Sep 09 20:32:56.914076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 314/614] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:56 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:57.426676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:57.427220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:57.433593 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:57.434062 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:57.434484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:57.435162 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:57.435605 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:57.436017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:57.563344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:57.571593 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d48568fc-5b87-446e-ac19-6a92b921be79 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1555 microversion: 2.1 time: 0.149496 Sep 09 20:32:57.572161 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 301/615] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:57 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:57.936810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:57.937513 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:57.944456 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:57.944935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:57.945402 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:57.946086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:57.946538 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:57.946959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:58.071360 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:58.078951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe615b28-62ef-4512-9d7c-cac2b8f2857f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1690 microversion: 2.1 time: 0.145983 Sep 09 20:32:58.079516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 315/616] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:57 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:58.595058 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:58.598973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:58.602329 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:58.602817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:58.603242 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:58.603927 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:58.604370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:58.604888 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:58.734688 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:58.743088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8605f32a-2fa1-449f-8d12-a93ac8da0755 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1555 microversion: 2.1 time: 0.151938 Sep 09 20:32:58.743657 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 302/617] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:58 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:59.102827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:59.103432 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:59.109760 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:59.110239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:59.110672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:59.111349 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:59.111795 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:59.112466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:59.239875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:59.247487 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09a6769d-c71b-4039-99ca-3571a53af8ef tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1690 microversion: 2.1 time: 0.148583 Sep 09 20:32:59.248057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 316/618] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:59 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:32:59.765973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:32:59.766588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:32:59.773573 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:59.774059 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:59.774493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:59.775184 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:32:59.775638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:32:59.776059 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:32:59.902290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:32:59.910571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e677e4f6-c366-4c85-a27f-017f98e2927c tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1555 microversion: 2.1 time: 0.148426 Sep 09 20:32:59.911147 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 303/619] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:32:59 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:00.272057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:00.272690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:00.279337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:00.280030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:00.280458 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:00.281138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:00.281607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:00.282021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:00.312938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-deee8ba6-6cb3-4fba-a460-11988bc944eb req-d461d6aa-c123-4c86-8706-962c0c5d6a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5303a6-d80f-4a4f-831b-4432191724db", "name": "network-vif-deleted", "tag": "b9b51f9a-0a54-4a10-bce6-3b821e125c22"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:00.325273 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-deee8ba6-6cb3-4fba-a460-11988bc944eb req-d461d6aa-c123-4c86-8706-962c0c5d6a6d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:00.325994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-deee8ba6-6cb3-4fba-a460-11988bc944eb req-d461d6aa-c123-4c86-8706-962c0c5d6a6d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:00.326619 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-deee8ba6-6cb3-4fba-a460-11988bc944eb req-d461d6aa-c123-4c86-8706-962c0c5d6a6d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:00.341112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-deee8ba6-6cb3-4fba-a460-11988bc944eb req-d461d6aa-c123-4c86-8706-962c0c5d6a6d service nova] Creating event network-vif-deleted:b9b51f9a-0a54-4a10-bce6-3b821e125c22 for instance 7a5303a6-d80f-4a4f-831b-4432191724db on hv-cinder-84932 Sep 09 20:33:00.347376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-deee8ba6-6cb3-4fba-a460-11988bc944eb req-d461d6aa-c123-4c86-8706-962c0c5d6a6d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038143 Sep 09 20:33:00.348565 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 304/620] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:00.358398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:00.370768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-09da9ec3-2944-4c4b-b283-d2ae3fdf1afd tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1623 microversion: 2.1 time: 0.102516 Sep 09 20:33:00.385059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 317/621] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:00 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1623 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:00.935533 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:00.936884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:00.944968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:00.945904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:00.946517 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:00.947486 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:00.948102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:00.948683 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:00.985602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:00.986317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:00.987163 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:00.987954 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lazy-loading 'fault' on Instance uuid 7a5303a6-d80f-4a4f-831b-4432191724db {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:01.038004 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec90aaf1a60746f69e5478987ab86bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5cdb6c865f4345be2de638e6ded3c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:01.046377 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7af31d27-1260-444f-8783-3829fbb066c6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 200 len: 1349 microversion: 2.1 time: 0.116007 Sep 09 20:33:01.062002 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 305/622] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:00 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 1349 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:01.398298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:01.398904 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:01.405464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:01.405939 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:01.406364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:01.407038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:01.407483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:01.407941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:01.440718 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:01.441200 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:01.441656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:01.442096 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lazy-loading 'fault' on Instance uuid 41051093-877e-41db-a9b9-d2c2624a3314 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:01.483247 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:01.492018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a927f807-65fd-496c-bef1-78fd396d2df9 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 200 len: 1335 microversion: 2.1 time: 0.097561 Sep 09 20:33:01.492518 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 318/623] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:01 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:02.070439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:02.071046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] [instance: 7a5303a6-d80f-4a4f-831b-4432191724db] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:02.077470 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:02.077945 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:02.078374 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:02.079059 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:02.079508 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:02.080417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:02.093364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] HTTP exception thrown: Instance 7a5303a6-d80f-4a4f-831b-4432191724db could not be found. Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Request method failure captured: Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db HTTP/1.1 Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6JPjLMy34gVuQNJ82FSNmosgEtFyA8qakHdUIKqS4kJzmbWy_Tt9fIO3-_ni9tRdZgUusm82e9FmoW9wuAcFqoag_bI5rO98ANBHTjd8u4ofMnEiZpYhETPv8I0oqKDWcUFj8yGA4VAjQlsjjOlP1ClsQ0nwwGZKfII4qTDhcLDQKU Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: da5cdb6c865f4345be2de638e6ded3c6 Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-TestMinimumBasicScenario-1443625129 Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:33:02.094961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_da5cdb6c865f4345be2de638e6ded3c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-TestMinimumBasicScenario-1443625129 Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: da5cdb6c865f4345be2de638e6ded3c6 Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1443625129 Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-TestMinimumBasicScenario-1443625129-project Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: ec90aaf1a60746f69e5478987ab86bc1 Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-TestMinimumBasicScenario-1443625129-project Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 7a5303a6-d80f-4a4f-831b-4432191724db could not be found. Sep 09 20:33:02.097117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '7a5303a6-d80f-4a4f-831b-4432191724db'} Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5303a6-d80f-4a4f-831b-4432191724db could not be found. Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:02.098148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5303a6-d80f-4a4f-831b-4432191724db could not be found. Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5303a6-d80f-4a4f-831b-4432191724db could not be found. Sep 09 20:33:02.099629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.101220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Returning 404 to user: Instance 7a5303a6-d80f-4a4f-831b-4432191724db could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:02.101220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-892ca02b-5810-48c3-a0ae-607c200ad51a tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db" status: 404 len: 111 microversion: 2.1 time: 0.030349 Sep 09 20:33:02.101220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 306/624] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:02 2022] GET /compute/v2.1/servers/7a5303a6-d80f-4a4f-831b-4432191724db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:33:02.105618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d1e8c07e-18ee-4c30-8db5-49297cfa29e6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] Calling method '.version_select at 0x7f4834968f70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:02.124281 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d1e8c07e-18ee-4c30-8db5-49297cfa29e6 tempest-TestMinimumBasicScenario-1443625129 tempest-TestMinimumBasicScenario-1443625129-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1530291827" status: 202 len: 0 microversion: 2.1 time: 0.022391 Sep 09 20:33:02.124820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 319/625] 10.222.0.26 () {58 vars in 1272 bytes} [Fri Sep 9 20:33:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1530291827 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:33:02.386880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-d882a030-237d-4166-9bc3-f727a30523dd req-9699feba-a684-49e1-9496-f19ff085769f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41051093-877e-41db-a9b9-d2c2624a3314", "name": "network-vif-deleted", "tag": "21f730a2-1ecb-4742-8ea6-973064a729fc"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:02.396902 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d882a030-237d-4166-9bc3-f727a30523dd req-9699feba-a684-49e1-9496-f19ff085769f service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:02.397408 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d882a030-237d-4166-9bc3-f727a30523dd req-9699feba-a684-49e1-9496-f19ff085769f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:02.397855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-d882a030-237d-4166-9bc3-f727a30523dd req-9699feba-a684-49e1-9496-f19ff085769f service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:02.410017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-d882a030-237d-4166-9bc3-f727a30523dd req-9699feba-a684-49e1-9496-f19ff085769f service nova] Creating event network-vif-deleted:21f730a2-1ecb-4742-8ea6-973064a729fc for instance 41051093-877e-41db-a9b9-d2c2624a3314 on hv-cinder-84932 Sep 09 20:33:02.415781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-d882a030-237d-4166-9bc3-f727a30523dd req-9699feba-a684-49e1-9496-f19ff085769f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Sep 09 20:33:02.416711 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 307/626] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:02.515278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:02.515905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 41051093-877e-41db-a9b9-d2c2624a3314] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:02.522471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:02.522957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:02.523395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:02.524130 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:02.524579 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:02.524999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:02.539954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] HTTP exception thrown: Instance 41051093-877e-41db-a9b9-d2c2624a3314 could not be found. Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Request method failure captured: Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 HTTP/1.1 Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6HiCOFZyuZ-ZTyWWLYgPe2Fl0u1RCs41Ue4gboYqbaAz9wKDooOGtWDJ0T5oZUyuL_oKMxGPSr25tvsKPqIJRJmt1_AcZ0WBVpWGm669vz3jv4XQdsbKybbhUvmaawpaQ9K7lypMpIGWpy2q2X_uBd_LiiE2b9xoECuB-UE7EFF45M Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:33:02.541634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f07defd609684351b4b7d0d110212a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: a95746e7a84541199b43138b1a348386 Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 41051093-877e-41db-a9b9-d2c2624a3314 could not be found. Sep 09 20:33:02.543291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '41051093-877e-41db-a9b9-d2c2624a3314'} Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41051093-877e-41db-a9b9-d2c2624a3314 could not be found. Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:02.544076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41051093-877e-41db-a9b9-d2c2624a3314 could not be found. Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41051093-877e-41db-a9b9-d2c2624a3314 could not be found. Sep 09 20:33:02.545441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:02.549922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Returning 404 to user: Instance 41051093-877e-41db-a9b9-d2c2624a3314 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:02.550719 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dfec2a47-783d-4ede-9ccc-a751978d47fe tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314" status: 404 len: 111 microversion: 2.1 time: 0.039594 Sep 09 20:33:02.551454 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 320/627] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:02 2022] GET /compute/v2.1/servers/41051093-877e-41db-a9b9-d2c2624a3314 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:33:02.560142 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f6632330-ae61-4c33-8fee-35a42c27fe0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '.version_select at 0x7f4834b4eee0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:02.583340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f6632330-ae61-4c33-8fee-35a42c27fe0d tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811301452" status: 202 len: 0 microversion: 2.1 time: 0.027393 Sep 09 20:33:02.584047 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 308/628] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Sep 9 20:33:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811301452 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:33:05.483874 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:05.484623 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:05.493123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:05.493796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:05.494362 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:05.495156 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:05.495724 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:05.496243 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:05.523936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:33:05.538868 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:05.612353 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-267b885e-15ee-4635-a7b7-d0da676238a5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "DELETE /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 204 len: 0 microversion: 2.1 time: 0.131707 Sep 09 20:33:05.616691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 321/629] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:33:05 2022] DELETE /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:33:05.622798 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:05.624131 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:05.631230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:05.631711 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:05.632136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:05.633028 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:05.633498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:05.633914 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:05.993548 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:06.002315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c3d46057-aab0-4d3a-8d33-61071ba9106f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1509 microversion: 2.1 time: 0.383860 Sep 09 20:33:06.002874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 309/630] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:05 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:07.028730 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:07.029675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:07.036404 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:07.036987 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:07.037689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:07.038494 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:07.039478 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:07.039899 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:07.304812 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:07.312885 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd67d3ad-cc44-42ff-9046-bcf0d10a93ed tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1509 microversion: 2.1 time: 0.288316 Sep 09 20:33:07.313710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 322/631] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:07 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:08.336298 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:08.336895 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:08.343867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:08.344526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:08.345737 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:08.346695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:08.347524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:08.348112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:08.353662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:08.421100 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:08.440050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-335069ec-e237-4030-82f8-68b58b8f1f46 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1467 microversion: 2.1 time: 0.107105 Sep 09 20:33:08.440885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 310/632] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:08 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1467 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:08.500352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c4f85872-9969-4e8d-9b72-df81aa290579 req-9bb7f78f-68fc-4ef3-ae08-44d011bd0154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609ef31d-c755-46cf-9bd4-d5373f9cb78d", "name": "network-vif-deleted", "tag": "ccc294b6-8a23-4205-8c36-01b2941e0c68"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:08.515427 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4f85872-9969-4e8d-9b72-df81aa290579 req-9bb7f78f-68fc-4ef3-ae08-44d011bd0154 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:08.516519 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4f85872-9969-4e8d-9b72-df81aa290579 req-9bb7f78f-68fc-4ef3-ae08-44d011bd0154 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:08.517496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c4f85872-9969-4e8d-9b72-df81aa290579 req-9bb7f78f-68fc-4ef3-ae08-44d011bd0154 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:08.538162 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c4f85872-9969-4e8d-9b72-df81aa290579 req-9bb7f78f-68fc-4ef3-ae08-44d011bd0154 service nova] Creating event network-vif-deleted:ccc294b6-8a23-4205-8c36-01b2941e0c68 for instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d on hv-cinder-84932 Sep 09 20:33:08.547151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c4f85872-9969-4e8d-9b72-df81aa290579 req-9bb7f78f-68fc-4ef3-ae08-44d011bd0154 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050756 Sep 09 20:33:08.552191 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 323/633] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:09.463362 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:09.464154 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:09.470626 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:09.471126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:09.471558 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:09.472243 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:09.472690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:09.473103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:09.507579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:09.508057 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:09.508483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:09.508919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lazy-loading 'fault' on Instance uuid 609ef31d-c755-46cf-9bd4-d5373f9cb78d {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:09.551924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:09.560681 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-375808d9-6232-44c4-944c-ffba2dc2bfd5 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 200 len: 1312 microversion: 2.1 time: 0.101117 Sep 09 20:33:09.564901 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 311/634] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:09 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:10.589211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:10.590053 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: 609ef31d-c755-46cf-9bd4-d5373f9cb78d] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:10.597778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:10.598261 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:10.598693 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:10.599388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:10.599833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:10.600250 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:10.614719 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] HTTP exception thrown: Instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d could not be found. Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Request method failure captured: Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d HTTP/1.1 Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6HiCOFZyuZ-ZTyWWLYgPe2Fl0u1RCs41Ue4gboYqbaAz9wKDooOGtWDJ0T5oZUyuL_oKMxGPSr25tvsKPqIJRJmt1_AcZ0WBVpWGm669vz3jv4XQdsbKybbhUvmaawpaQ9K7lypMpIGWpy2q2X_uBd_LiiE2b9xoECuB-UE7EFF45M Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:33:10.616403 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f07defd609684351b4b7d0d110212a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: a95746e7a84541199b43138b1a348386 Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d could not be found. Sep 09 20:33:10.618018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '609ef31d-c755-46cf-9bd4-d5373f9cb78d'} Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d could not be found. Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:10.622075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d could not be found. Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d could not be found. Sep 09 20:33:10.623337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:10.624444 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Returning 404 to user: Instance 609ef31d-c755-46cf-9bd4-d5373f9cb78d could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:10.624444 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1b794109-28cc-4f3e-b80b-365c2dbefe75 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d" status: 404 len: 111 microversion: 2.1 time: 0.033104 Sep 09 20:33:10.624444 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 324/635] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:10 2022] GET /compute/v2.1/servers/609ef31d-c755-46cf-9bd4-d5373f9cb78d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:33:10.627497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:10.628632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:10.635532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:10.636020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:10.636511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:10.637225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:10.637708 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:10.638134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:10.670376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:33:10.766307 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7c2dc2f0-bf5f-4d06-a1a2-8065eeac2885 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 204 len: 0 microversion: 2.1 time: 0.142893 Sep 09 20:33:10.767651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 312/636] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:33:10 2022] DELETE /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:33:10.775389 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:10.775992 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:10.782168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:10.782731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:10.783274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:10.784018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:10.784490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:10.784914 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:10.918452 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:10.926089 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0ed9d244-a1d4-4734-91fe-93d02c4a3f3f tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.154493 Sep 09 20:33:10.926591 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 325/637] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:10 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:11.949858 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:11.950495 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:11.957016 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:11.957528 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:11.957967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:11.958659 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:11.959113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:11.959540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:12.086639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:12.094233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-947ae505-90ff-4468-a673-2770f4f31e85 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.148719 Sep 09 20:33:12.094795 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 313/638] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:11 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:13.117032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:13.117772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:13.124420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:13.124902 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:13.125388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:13.126548 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:13.126999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:13.127413 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:13.260601 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:13.268769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fda57ca1-48f6-41db-8349-1fc3c047b0d2 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.155592 Sep 09 20:33:13.269354 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 326/639] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:13 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:14.291563 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:14.292169 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:14.299102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:14.299576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:14.300006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:14.300743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:14.301197 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:14.301643 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:14.437730 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95746e7a84541199b43138b1a348386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f07defd609684351b4b7d0d110212a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:14.446623 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96cf2840-3025-4f3c-a2d4-82c9cde5cb2c tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 200 len: 1522 microversion: 2.1 time: 0.158885 Sep 09 20:33:14.447284 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 314/640] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:14 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:14.472320 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8ef602b4-9057-417a-9304-e95d464e66ef req-60b61c44-01d2-4d71-a742-675f2f0ec00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5", "name": "network-vif-deleted", "tag": "727b9f9f-0d7b-470a-ba5d-2023a0e7304d"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:14.484717 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ef602b4-9057-417a-9304-e95d464e66ef req-60b61c44-01d2-4d71-a742-675f2f0ec00c service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:14.485195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ef602b4-9057-417a-9304-e95d464e66ef req-60b61c44-01d2-4d71-a742-675f2f0ec00c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:14.486228 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8ef602b4-9057-417a-9304-e95d464e66ef req-60b61c44-01d2-4d71-a742-675f2f0ec00c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:14.499215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8ef602b4-9057-417a-9304-e95d464e66ef req-60b61c44-01d2-4d71-a742-675f2f0ec00c service nova] Creating event network-vif-deleted:727b9f9f-0d7b-470a-ba5d-2023a0e7304d for instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 on hv-cinder-84932 Sep 09 20:33:14.504000 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8ef602b4-9057-417a-9304-e95d464e66ef req-60b61c44-01d2-4d71-a742-675f2f0ec00c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036144 Sep 09 20:33:14.504596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 327/641] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:15.470251 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:15.470851 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] [instance: fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:15.477096 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:15.477598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:15.478022 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:15.478696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:15.479141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:15.479557 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:15.492687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] HTTP exception thrown: Instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 could not be found. Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Request method failure captured: Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 HTTP/1.1 Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HiCOFZyuZ-ZTyWWLYgPe2Fl0u1RCs41Ue4gboYqbaAz9wKDooOGtWDJ0T5oZUyuL_oKMxGPSr25tvsKPqIJRJmt1_AcZ0WBVpWGm669vz3jv4XQdsbKybbhUvmaawpaQ9K7lypMpIGWpy2q2X_uBd_LiiE2b9xoECuB-UE7EFF45M Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:33:15.494308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f07defd609684351b4b7d0d110212a7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f07defd609684351b4b7d0d110212a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: f07defd609684351b4b7d0d110212a7c Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-404208800 Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: a95746e7a84541199b43138b1a348386 Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-404208800-project Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 could not be found. Sep 09 20:33:15.495823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5'} Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 could not be found. Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:15.496678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 could not be found. Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 could not be found. Sep 09 20:33:15.498140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:15.499413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] Returning 404 to user: Instance fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:15.499413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-76070bfd-f9e2-47ad-97eb-ca5bf6ec3a47 tempest-ServerRescueNegativeTestJSON-404208800 tempest-ServerRescueNegativeTestJSON-404208800-project] 10.222.0.26 "GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5" status: 404 len: 111 microversion: 2.1 time: 0.029311 Sep 09 20:33:15.499413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 315/642] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:15 2022] GET /compute/v2.1/servers/fa3c0b52-fb60-41c6-b85e-8aa058aaa4c5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:33:16.412678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:16.413231 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:16.419361 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:16.419837 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:16.420259 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:16.420939 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:16.421412 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:16.421826 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:16.446106 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fa4d9793-f4e9-44f0-8839-b991668fb8c7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/ips" status: 200 len: 152 microversion: 2.20 time: 0.037926 Sep 09 20:33:16.446691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 328/643] 10.222.0.26 () {60 vars in 1289 bytes} [Fri Sep 9 20:33:16 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:33:17.600667 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:17.601717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:17.607870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:17.608347 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:17.608778 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:17.609488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:17.609933 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:17.610380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:17.635147 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-578d8343-2b3b-4e04-9a50-f0732b51310f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/ips" status: 200 len: 145 microversion: 2.1 time: 0.228030 Sep 09 20:33:17.635691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 316/644] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:33:17 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/ips => generated 145 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:33:19.033146 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7d7d385-614a-46b1-a772-6f6ba2242c08"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:19.036282 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:19.042811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:19.043468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:19.044105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:19.044869 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:19.045537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:19.045964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:19.307799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:19.308416 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:19.315865 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:19.316354 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:19.316994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:19.317884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:19.318345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:19.318806 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:19.344572 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lazy-loading 'flavor' on Instance uuid e85693f6-363f-443c-a6db-0db004b654ae {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:19.352259 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d40bdca3-e8dc-4081-b51d-132add4dc2a6 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322805 Sep 09 20:33:19.352984 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 329/645] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:33:19 2022] POST /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:19.575152 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4078e024-6fdd-48ab-84d5-55ead94620bd tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/action" status: 202 len: 0 microversion: 2.20 time: 0.487541 Sep 09 20:33:19.575747 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 317/646] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Sep 9 20:33:19 2022] POST /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 20:33:19.585338 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:19.586030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:19.592824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:19.593530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:19.594173 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:19.595231 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:19.595722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:19.596342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:19.735948 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:19.744325 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:19.745912 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:19.747062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dfb909b5-7413-487d-8d18-5d08178559d3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.166427 Sep 09 20:33:19.747655 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 330/647] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:19 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:33:20.773855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:20.774781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:20.780253 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:20.783096 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:20.783677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:20.784343 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:20.785161 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:20.785837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:20.786733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:21.006911 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:21.015635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:21.017111 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:21.018346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cca12626-8531-4b86-aed4-d03b41bd9d0f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.249238 Sep 09 20:33:21.018910 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 318/648] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:20 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:22.048072 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:22.049559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:22.061217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:22.061737 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:22.062351 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:22.066794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:22.067267 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:22.067876 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:22.296032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:22.305063 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:22.308077 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:22.309439 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9c08fb02-cf78-4da2-8a1f-8aeb77ce029e tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.265527 Sep 09 20:33:22.310103 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 331/649] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:22 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:23.341534 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:23.343305 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:23.351727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:23.353091 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:23.353854 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:23.354825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:23.355526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:23.356238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:23.595991 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:23.604912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:23.606390 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:23.607914 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ff04d35-4efd-48de-b814-b37bb73f5411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.271449 Sep 09 20:33:23.608883 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 319/650] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:23 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:24.404758 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-011ea964-a070-44b5-bdad-3f6bb74bd5bd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: .version_select at 0x7f483498df70>, body: {"keypair": {"name": "tempest-keypair-165947215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNthLlX/lVENTvO3BVtAdqrrrtPz4+iVqPma6/e3FHdh8+EkyiPd4aml/aPUHeWuOwGbjUIRYiNoMkx2dfBYDpaSKOnS1LQGPSpJNS5eawZj4kGlbTTyir6Q3Q9TyaJ3qw=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:24.410888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:24.424490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-011ea964-a070-44b5-bdad-3f6bb74bd5bd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:33:24.428729 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-011ea964-a070-44b5-bdad-3f6bb74bd5bd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:33:24.452040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-011ea964-a070-44b5-bdad-3f6bb74bd5bd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167922 Sep 09 20:33:24.452960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 332/651] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:33:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:24.637648 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:24.638420 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:24.645125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:24.645724 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:24.646090 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:24.647179 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:24.647768 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:24.648087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:24.860981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:24.870262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:24.871690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:24.872861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7daf6fdb-e6b8-47c7-9231-87aafb335f2f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.239362 Sep 09 20:33:24.873446 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 320/652] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:24 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:25.880021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1286403884", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acf3cd1a-b4b0-4a34-82b2-e2951d096a8f"}], "security_groups": [{"name": "tempest-securitygroup--599612254"}], "key_name": "tempest-keypair-165947215", "user_data": "}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:25.898287 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:25.898883 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:25.907444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:25.908114 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:25.908703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:25.909605 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:25.910199 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:25.910767 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:26.026512 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] validate_networks() for [('acf3cd1a-b4b0-4a34-82b2-e2951d096a8f', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:33:26.394780 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:26.406981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:26.408730 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:26.412769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e9a33e7-dcc6-419e-9664-53e2ce012405 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.518012 Sep 09 20:33:26.413967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 321/653] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:25 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:26.418787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:26.420977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:26.427376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:26.427844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:26.428266 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:26.428943 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:26.429419 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:26.429842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:26.460373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-030fa67c-7d77-4863-b607-d2ab2c3b93aa tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Sep 09 20:33:26.460938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 322/654] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:33:26 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:26.472212 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:26.472703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:26.478858 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:26.479339 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:26.479765 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:26.480455 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:26.480901 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:26.481349 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:26.508094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:26.512639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b4e1cf24-34d0-473a-8002-39d082bd7e47 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/e7d7d385-614a-46b1-a772-6f6ba2242c08" status: 200 len: 194 microversion: 2.1 time: 0.044952 Sep 09 20:33:26.517613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 323/655] 10.222.0.26 () {58 vars in 1413 bytes} [Fri Sep 9 20:33:26 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/e7d7d385-614a-46b1-a772-6f6ba2242c08 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:26.787701 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:33:26.788308 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:33:26.788958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:33:26.789496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:33:26.789913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:33:26.803586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:26.804073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:26.804510 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:26.805239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:26.810010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:26.810713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:26.834993 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:33:26.840409 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:33:26.872092 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:33:26.874449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:33:26.923979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f45ae38d-066d-4b00-bb81-16636167a285 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.049181 Sep 09 20:33:26.924726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 333/656] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:33:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:33:26.935856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-533bc6d0-28c6-4df3-b248-f015aaa2473d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:26.936601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-533bc6d0-28c6-4df3-b248-f015aaa2473d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:26.994887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-533bc6d0-28c6-4df3-b248-f015aaa2473d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:27.003681 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-533bc6d0-28c6-4df3-b248-f015aaa2473d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1241 microversion: 2.1 time: 0.071773 Sep 09 20:33:27.005522 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 324/657] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:26 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:27.438937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:27.439586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:27.446556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:27.447249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:27.447692 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:27.448385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:27.449002 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:27.449587 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:27.583606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:27.593001 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:27.595438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:27.596630 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e6cbe671-869e-44a9-b7dd-dafa8208ff8c tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.161787 Sep 09 20:33:27.597195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 334/658] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:27 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:27.916788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12b33afe-3226-43db-b016-ef83d465eb90"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:27.919545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:27.926972 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:27.927595 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:27.928030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:27.928724 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:27.929172 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:27.929635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:28.027284 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:28.028019 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:28.035020 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:28.035494 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:28.035919 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:28.036598 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:28.037044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:28.037511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:28.103682 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:28.112358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4acb98c7-2a79-4cd5-aafd-c26963991338 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1293 microversion: 2.1 time: 0.088855 Sep 09 20:33:28.112924 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 335/659] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:28 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:28.405271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bff2507e-c8c9-468e-a6fe-034dea3abfef tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "POST /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492253 Sep 09 20:33:28.406023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 325/660] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:33:27 2022] POST /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:28.623461 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:28.624066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:28.630616 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:28.631107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:28.631541 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:28.632221 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:28.632669 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:28.633090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:28.774710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:28.783359 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:28.784779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:28.785948 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fb9bb56d-e64e-4f2c-be11-d9be750d2411 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.166465 Sep 09 20:33:28.786496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 336/661] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:28 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:29.136496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:29.137189 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:29.155212 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:29.155996 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:29.156747 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:29.157742 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:29.158543 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:29.160820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:29.343915 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:29.353083 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8d8f0ce-bd5b-412b-91e1-4f16bc92329d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1366 microversion: 2.1 time: 0.221160 Sep 09 20:33:29.362276 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 326/662] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:29 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:29.811710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:29.812258 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:29.818670 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:29.819151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:29.819585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:29.820305 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:29.820754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:29.821203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:29.955483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:29.963554 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:29.965022 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:29.966191 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f9f37b29-ea77-41c5-9fbc-06e8126ff840 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.158542 Sep 09 20:33:29.966935 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 337/663] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:29 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:30.160925 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b1eef5a9-e26d-49aa-bd83-75cc8024eb71 req-fa8bf3f4-840b-449b-9a0f-2eefb5143fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ad8e52-a548-49df-88d4-9969d1bcf873", "tag": "ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:30.173191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b1eef5a9-e26d-49aa-bd83-75cc8024eb71 req-fa8bf3f4-840b-449b-9a0f-2eefb5143fa0 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:30.173705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b1eef5a9-e26d-49aa-bd83-75cc8024eb71 req-fa8bf3f4-840b-449b-9a0f-2eefb5143fa0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:30.174136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b1eef5a9-e26d-49aa-bd83-75cc8024eb71 req-fa8bf3f4-840b-449b-9a0f-2eefb5143fa0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:30.186377 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b1eef5a9-e26d-49aa-bd83-75cc8024eb71 req-fa8bf3f4-840b-449b-9a0f-2eefb5143fa0 service nova] Creating event network-changed:ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba for instance 85ad8e52-a548-49df-88d4-9969d1bcf873 on hv-cinder-84932 Sep 09 20:33:30.191015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b1eef5a9-e26d-49aa-bd83-75cc8024eb71 req-fa8bf3f4-840b-449b-9a0f-2eefb5143fa0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034456 Sep 09 20:33:30.191618 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 327/664] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:30.378266 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:30.378902 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:30.385348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:30.385764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:30.386189 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:30.387015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:30.387461 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:30.387875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:30.518877 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:30.526516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5fb56b9e-fc0a-470f-ac62-88c70d0b5a26 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1366 microversion: 2.1 time: 0.152710 Sep 09 20:33:30.527075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 338/665] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:30 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:30.992756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:30.993489 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:31.000037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:31.000515 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:31.000950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:31.001660 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:31.002113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:31.002534 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:31.137041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:31.147445 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:31.148900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:31.150122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0b9a7254-ef15-406b-9d18-a7bb9f6ef7af tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1745 microversion: 2.20 time: 0.161666 Sep 09 20:33:31.150930 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 328/666] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:30 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:31.549072 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:31.549706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:31.556093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:31.556568 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:31.556995 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:31.557703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:31.558152 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:31.558570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:31.693586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:31.695796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:31.702190 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6d796ff1-54c7-44c5-9f29-431a460665c0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1366 microversion: 2.1 time: 0.157008 Sep 09 20:33:31.702767 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 339/667] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:31 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:32.176341 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:32.177141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:32.183829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:32.184588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:32.185209 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:32.185944 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:32.186404 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:32.186828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:32.327970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:32.337677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:32.340047 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:32.341225 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4876cb66-a7ba-48b1-ba29-5c44d5304585 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.169327 Sep 09 20:33:32.341799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 329/668] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:32 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:32.728047 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:32.728654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:32.738647 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:32.744464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:32.745163 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:32.746280 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:32.746925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:32.747606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:32.927337 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:32.937271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56e17197-e740-4b27-a69a-a874e58bfae8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1366 microversion: 2.1 time: 0.213027 Sep 09 20:33:32.938099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 340/669] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:32 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:33.367240 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:33.367848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:33.377406 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:33.378131 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:33.378755 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:33.379622 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:33.380239 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:33.380663 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:33.530752 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:33.542738 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:33.544372 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:33.545950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86c1f818-beb2-4cd1-b4cd-98e4b3aa5881 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.182622 Sep 09 20:33:33.546638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 330/670] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:33 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:33.960867 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:33.962265 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:33.968683 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:33.978162 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:33.978957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:33.979716 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:33.980189 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:33.980611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:34.145671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-93bcd005-0415-46df-a40e-a39dd3292f02 req-252b78dc-6b1d-4745-9f7c-7d7613da5675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad8e52-a548-49df-88d4-9969d1bcf873", "name": "network-vif-plugged", "status": "completed", "tag": "ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:34.150675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:34.164703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0e2cb6ec-2f25-4314-97ae-4ef95784be32 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1366 microversion: 2.1 time: 0.208425 Sep 09 20:33:34.166241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 341/671] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:33 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:34.172372 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-93bcd005-0415-46df-a40e-a39dd3292f02 req-252b78dc-6b1d-4745-9f7c-7d7613da5675 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:34.172846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-93bcd005-0415-46df-a40e-a39dd3292f02 req-252b78dc-6b1d-4745-9f7c-7d7613da5675 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:34.173297 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-93bcd005-0415-46df-a40e-a39dd3292f02 req-252b78dc-6b1d-4745-9f7c-7d7613da5675 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:34.188124 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-93bcd005-0415-46df-a40e-a39dd3292f02 req-252b78dc-6b1d-4745-9f7c-7d7613da5675 service nova] Creating event network-vif-plugged:ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba for instance 85ad8e52-a548-49df-88d4-9969d1bcf873 on hv-cinder-84932 Sep 09 20:33:34.194571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-93bcd005-0415-46df-a40e-a39dd3292f02 req-252b78dc-6b1d-4745-9f7c-7d7613da5675 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055321 Sep 09 20:33:34.195864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 331/672] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:34.571274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:34.571884 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:34.578941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:34.579420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:34.580020 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:34.580894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:34.581534 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:34.582130 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:34.726283 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:34.735299 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:34.737238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:34.738676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5050b85-b7c3-4e49-bdd3-9ea6d8a27424 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.171306 Sep 09 20:33:34.739387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 342/673] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:34 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:35.193344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:35.194058 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:35.215199 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:35.217717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:35.220160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:35.222094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:35.225275 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:35.225874 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:35.405056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:35.414090 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-101b9fe4-985d-4a7a-bb2c-c9c5661e8e42 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1366 microversion: 2.1 time: 0.225214 Sep 09 20:33:35.414681 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 332/674] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:35 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:35.764778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:35.765417 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:35.772545 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:35.773044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:35.773520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:35.774234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:35.774821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:35.775429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:35.914052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:35.926659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:35.928582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:35.929960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d5ea47e2-8268-4f93-be47-104085dfc073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.169207 Sep 09 20:33:35.930849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 343/675] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:35 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:36.018796 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:36.021358 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:36.027941 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.028696 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.028979 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.029820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.030349 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.030850 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.063762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ee605058-2cb4-454f-bde8-e3b1ec82553b tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049739 Sep 09 20:33:36.064570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 333/676] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:33:36 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:36.171602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:36.172181 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:36.181279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.181878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.182398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.183230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.183696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.184206 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.218287 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f6f28eb3-91e8-4b42-837e-a9919d30d770 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/e7d7d385-614a-46b1-a772-6f6ba2242c08" status: 200 len: 194 microversion: 2.1 time: 0.050286 Sep 09 20:33:36.219423 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 344/677] 10.222.0.26 () {58 vars in 1413 bytes} [Fri Sep 9 20:33:36 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/e7d7d385-614a-46b1-a772-6f6ba2242c08 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:36.229642 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:36.230120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:36.238551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-0d1ca85c-034b-4463-9bfe-b3db8dd9f908 req-a294a525-967f-4907-9084-bd989a04d0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85693f6-363f-443c-a6db-0db004b654ae", "name": "network-vif-plugged", "status": "completed", "tag": "dc8afa85-2831-4191-870d-42e15a736429"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:36.244912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.245679 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.246377 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.247398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.248138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0d1ca85c-034b-4463-9bfe-b3db8dd9f908 req-a294a525-967f-4907-9084-bd989a04d0d4 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.248468 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.248619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0d1ca85c-034b-4463-9bfe-b3db8dd9f908 req-a294a525-967f-4907-9084-bd989a04d0d4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.249049 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-0d1ca85c-034b-4463-9bfe-b3db8dd9f908 req-a294a525-967f-4907-9084-bd989a04d0d4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.249567 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.262412 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-0d1ca85c-034b-4463-9bfe-b3db8dd9f908 req-a294a525-967f-4907-9084-bd989a04d0d4 service nova] Creating event network-vif-plugged:dc8afa85-2831-4191-870d-42e15a736429 for instance e85693f6-363f-443c-a6db-0db004b654ae on hv-cinder-84932 Sep 09 20:33:36.267821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-0d1ca85c-034b-4463-9bfe-b3db8dd9f908 req-a294a525-967f-4907-9084-bd989a04d0d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033069 Sep 09 20:33:36.268732 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 345/678] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:36.380562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lazy-loading 'services' on Instance uuid e208f300-e8f3-44d5-9b42-27b8815e811f {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:36.439779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:36.440582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:36.447772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.448418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.448930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.449852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.450406 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.450993 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.483415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-09d40e7c-b3ef-4235-9bff-26f77b71c065 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/e7d7d385-614a-46b1-a772-6f6ba2242c08" status: 202 len: 0 microversion: 2.1 time: 0.257141 Sep 09 20:33:36.484649 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 334/679] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:33:36 2022] DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/e7d7d385-614a-46b1-a772-6f6ba2242c08 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:33:36.605449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:36.614422 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-094aace6-5f94-446b-b735-0a8c44fd5e61 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1366 microversion: 2.1 time: 0.179815 Sep 09 20:33:36.618693 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 346/680] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:36 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:36.958322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:36.959527 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:36.967472 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.968190 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.968782 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:36.970182 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:36.970703 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:36.971577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:37.013005 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:37.154876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:37.165938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:37.167532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:37.169188 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-05727736-7c89-4c7a-83b1-01fa0e1ccbd2 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.216974 Sep 09 20:33:37.169977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 335/681] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:36 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:33:37.639230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:37.640492 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:37.644651 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:37.645534 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=10 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:37.649840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:37.650596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:37.651223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:37.651937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:37.652392 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:37.652836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:37.806920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:37.820404 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-27d08d64-2de0-4450-948e-c11ea55fec46 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1555 microversion: 2.1 time: 0.185314 Sep 09 20:33:37.821050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 347/682] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:37 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:37.846702 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:37.847955 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:37.854732 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:37.855453 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:37.856076 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:37.857162 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:37.857656 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:37.858837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:37.940828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d17f3ced-1098-4711-a1df-9bb9a330c8db tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098408 Sep 09 20:33:37.945596 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 336/683] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:33:37 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:38.196081 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:38.197531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:38.204681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:38.206545 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:38.206545 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:38.206545 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:38.206893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:38.207276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:38.379302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:38.388810 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:38.391025 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:38.392428 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ec7cfed6-47c3-4303-ad88-0d22e9197f6f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.200742 Sep 09 20:33:38.405699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 348/684] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:38 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:38.693331 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:38.694085 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:38.700950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:38.701523 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:38.702286 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:38.704630 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:38.704630 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:38.704630 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:38.743122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d94a94ec-3cec-49d1-9a14-a1ed72db63ed tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/12b33afe-3226-43db-b016-ef83d465eb90" status: 200 len: 194 microversion: 2.1 time: 0.054576 Sep 09 20:33:38.756187 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:38.757562 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:38.761603 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 337/685] 10.222.0.26 () {58 vars in 1413 bytes} [Fri Sep 9 20:33:38 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/12b33afe-3226-43db-b016-ef83d465eb90 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:38.765399 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:38.766209 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:38.766809 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:38.767679 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:38.768129 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:38.768544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:38.872127 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lazy-loading 'services' on Instance uuid e208f300-e8f3-44d5-9b42-27b8815e811f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:38.977449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0b243dd1-a9cd-459a-b4e2-5e154ae73db3 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/12b33afe-3226-43db-b016-ef83d465eb90" status: 202 len: 0 microversion: 2.1 time: 0.225242 Sep 09 20:33:38.981904 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 349/686] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:33:38 2022] DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments/12b33afe-3226-43db-b016-ef83d465eb90 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 20:33:39.222838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-73ca41fb-f1ca-4b1c-84d4-45c458c68636 req-c870dfc1-755a-4cdd-a42f-0715262f1903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ad8e52-a548-49df-88d4-9969d1bcf873", "tag": "ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:39.234122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-73ca41fb-f1ca-4b1c-84d4-45c458c68636 req-c870dfc1-755a-4cdd-a42f-0715262f1903 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:39.234735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-73ca41fb-f1ca-4b1c-84d4-45c458c68636 req-c870dfc1-755a-4cdd-a42f-0715262f1903 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:39.235235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-73ca41fb-f1ca-4b1c-84d4-45c458c68636 req-c870dfc1-755a-4cdd-a42f-0715262f1903 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:39.247760 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-73ca41fb-f1ca-4b1c-84d4-45c458c68636 req-c870dfc1-755a-4cdd-a42f-0715262f1903 service nova] Creating event network-changed:ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba for instance 85ad8e52-a548-49df-88d4-9969d1bcf873 on hv-cinder-84932 Sep 09 20:33:39.263126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-73ca41fb-f1ca-4b1c-84d4-45c458c68636 req-c870dfc1-755a-4cdd-a42f-0715262f1903 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125083 Sep 09 20:33:39.264037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 338/687] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:33:39.426265 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:39.427619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:39.434015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:39.434650 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:39.435153 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:39.435908 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:39.436428 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:39.436913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:39.612440 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:39.621991 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:39.632971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:39.634248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-486eda1d-dbb0-4ab0-9236-14ff7eeeac1f tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.213321 Sep 09 20:33:39.634825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 350/688] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:39 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:40.242433 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:40.246064 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:40.254764 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.255594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.256315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.257532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.258788 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.259433 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.308534 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dec1b3a7-a4d6-4818-a956-c40b5ddac6fc tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071124 Sep 09 20:33:40.309238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 339/689] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:33:40 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 20:33:40.475034 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:40.477604 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:40.496142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.496804 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.497551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.498516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.499280 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.500531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.538035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b8b96ae1-8876-4859-ae38-f329ef5f4a84 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080769 Sep 09 20:33:40.547632 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 351/690] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:33:40 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:33:40.614260 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:40.614777 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:40.623551 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.625460 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.626370 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.627723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.631932 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.632893 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.663441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:40.664296 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:40.682383 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.684901 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.692607 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.693639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.694223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.694734 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.716688 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:33:40.764403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:40.835130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9c5f2a66-a675-4a8e-8562-450ac06dabe9 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 204 len: 0 microversion: 2.1 time: 0.227583 Sep 09 20:33:40.838472 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 340/691] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:33:40 2022] DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:33:40.849968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:40.854179 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:40.883143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.883684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.884180 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.885814 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:40.886311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:40.886783 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:40.887210 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:40.896561 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:40.898301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:40.899698 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-857771fa-61d9-4ab1-a592-0d0acd636ae0 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.240340 Sep 09 20:33:40.905610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 352/692] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:40 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:33:41.041841 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:41.053469 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-069537ee-d9aa-48ab-8eff-43a635fee68f tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1673 microversion: 2.1 time: 0.209957 Sep 09 20:33:41.054054 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 341/693] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:40 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:41.927557 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:41.928797 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:41.935671 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:41.936153 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:41.936592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:41.937412 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:41.937871 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:41.938289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:42.076738 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:42.077367 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:42.092908 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:42.094368 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:42.094966 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:42.095819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:42.096420 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:42.097017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:42.115186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:42.124461 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:42.129961 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:42.131317 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ae62cea6-b5a6-4d7a-ae07-0ca367c51072 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1740 microversion: 2.20 time: 0.207879 Sep 09 20:33:42.135636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 353/694] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:41 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:42.274787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:42.293750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-67d1e150-1c51-45e6-9fe6-40f1b260d31a tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1673 microversion: 2.1 time: 0.220848 Sep 09 20:33:42.296113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 342/695] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:42 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:43.162502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:43.163097 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:43.169421 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:43.169902 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:43.170330 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:43.171017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:43.171466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:43.171885 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:43.303773 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:43.316349 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:43.317060 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:43.322196 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:43.325400 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:43.326945 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:43.328302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3f94e0d6-e80e-4cf8-9a3f-c92052afded7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1722 microversion: 2.20 time: 0.169808 Sep 09 20:33:43.329029 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:43.329568 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:43.330624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:43.331510 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 354/696] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:43 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:43.331640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:43.331925 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:43.479570 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:43.488345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1451f274-aef2-4084-874d-33dae8126637 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1673 microversion: 2.1 time: 0.176311 Sep 09 20:33:43.488921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 343/697] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:43 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:33:44.140690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-8a80f9d6-6696-4f08-b157-650fd1f80ebb req-cfaa449a-4897-4189-9c13-79a520ca27c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e208f300-e8f3-44d5-9b42-27b8815e811f", "name": "network-vif-deleted", "tag": "0ae3bddd-935a-4674-81de-0492ee6b5ef0"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:44.151909 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8a80f9d6-6696-4f08-b157-650fd1f80ebb req-cfaa449a-4897-4189-9c13-79a520ca27c2 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:44.152631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8a80f9d6-6696-4f08-b157-650fd1f80ebb req-cfaa449a-4897-4189-9c13-79a520ca27c2 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:44.153160 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-8a80f9d6-6696-4f08-b157-650fd1f80ebb req-cfaa449a-4897-4189-9c13-79a520ca27c2 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:44.165778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-8a80f9d6-6696-4f08-b157-650fd1f80ebb req-cfaa449a-4897-4189-9c13-79a520ca27c2 service nova] Creating event network-vif-deleted:0ae3bddd-935a-4674-81de-0492ee6b5ef0 for instance e208f300-e8f3-44d5-9b42-27b8815e811f on hv-cinder-84932 Sep 09 20:33:44.172496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-8a80f9d6-6696-4f08-b157-650fd1f80ebb req-cfaa449a-4897-4189-9c13-79a520ca27c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035060 Sep 09 20:33:44.173424 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 355/698] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:44.356130 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:44.356839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:44.364009 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:44.364567 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:44.365072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:44.365800 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:44.366251 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:44.366673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:44.501924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:44.510212 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:44.511653 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:44.512582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:44.513034 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-77ab5cff-498b-4787-a67b-d801dc35e060 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1722 microversion: 2.20 time: 0.160986 Sep 09 20:33:44.513299 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:44.513625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 344/699] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:44 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:33:44.519793 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:44.520281 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:44.520717 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:44.521440 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:44.521892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:44.522313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:44.553642 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:44.554124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:44.554561 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:44.554992 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lazy-loading 'fault' on Instance uuid e208f300-e8f3-44d5-9b42-27b8815e811f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:44.596526 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:44.598819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:44.606215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f026eec9-f24a-46da-9f01-3496e915cdbe tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1328 microversion: 2.1 time: 0.097843 Sep 09 20:33:44.606905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 356/700] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:44 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:45.537989 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:45.538586 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:45.544894 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:45.545409 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:45.545842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:45.547112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:45.547559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:45.547977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:45.629750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:45.630367 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:45.637188 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:45.637697 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:45.638139 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:45.638855 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:45.639311 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:45.639733 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:45.672842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:45.673366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:45.674209 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:45.674209 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lazy-loading 'fault' on Instance uuid e208f300-e8f3-44d5-9b42-27b8815e811f {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:33:45.678472 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:45.686598 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:45.688023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:45.689164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9cca95d8-1360-4f31-b654-ab6890c4f10a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1722 microversion: 2.20 time: 0.155114 Sep 09 20:33:45.689744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 345/701] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:45 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:45.714347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bc48b6541c4388b45435036a1c4525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b310c05b03394f11b63f0a28f13d67b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:45.722772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2d74d9c8-3aae-44cf-a526-df7559a78f62 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 200 len: 1328 microversion: 2.1 time: 0.096868 Sep 09 20:33:45.723334 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 357/702] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:45 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:33:46.074394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7f25aa83-af1e-4df0-b191-7567c1d55e8c req-9af78f15-91e1-4b3f-a44c-d4adbd4b437c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85693f6-363f-443c-a6db-0db004b654ae", "name": "network-vif-unplugged", "status": "completed", "tag": "dc8afa85-2831-4191-870d-42e15a736429"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:46.085695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7f25aa83-af1e-4df0-b191-7567c1d55e8c req-9af78f15-91e1-4b3f-a44c-d4adbd4b437c service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:46.086260 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7f25aa83-af1e-4df0-b191-7567c1d55e8c req-9af78f15-91e1-4b3f-a44c-d4adbd4b437c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:46.086876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7f25aa83-af1e-4df0-b191-7567c1d55e8c req-9af78f15-91e1-4b3f-a44c-d4adbd4b437c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:46.104782 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7f25aa83-af1e-4df0-b191-7567c1d55e8c req-9af78f15-91e1-4b3f-a44c-d4adbd4b437c service nova] Creating event network-vif-unplugged:dc8afa85-2831-4191-870d-42e15a736429 for instance e85693f6-363f-443c-a6db-0db004b654ae on hv-cinder-84932 Sep 09 20:33:46.110508 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7f25aa83-af1e-4df0-b191-7567c1d55e8c req-9af78f15-91e1-4b3f-a44c-d4adbd4b437c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039976 Sep 09 20:33:46.111106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 346/703] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:33:46.714957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:46.715565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:46.722466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:46.722950 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:46.723385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:46.724066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:46.724517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:46.724937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:46.745571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:46.746304 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:46.752378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:46.752859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:46.753316 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:46.753998 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:46.754446 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:46.754861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:46.768179 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] HTTP exception thrown: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Request method failure captured: Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f HTTP/1.1 Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HayXe9FnQ3-Xd62JpzW7BxAg1hi5j_CJEOcR7I8r6Jc601vxkg4n9ZBdD7QfFzuP9uhRnTGNS5k9ArRcPbK1YNtFfavm883F_LC9lNp4i9Y9aqVEry_jivRI1hVjS6EV58qezFYWpR2lKCBWnFTSmxwNekfRtLmRZNYVuJwPTmL1k Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:33:46.769853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 95bc48b6541c4388b45435036a1c4525 Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:46.771546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'e208f300-e8f3-44d5-9b42-27b8815e811f'} Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:46.772628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:46.774230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:46.775769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Returning 404 to user: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:46.775769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f174574-4bf3-42b3-97d9-e60d8048d094 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 404 len: 111 microversion: 2.1 time: 0.030310 Sep 09 20:33:46.775769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 347/704] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:46 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:33:46.779719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2b73a5d0-d3d8-4e3f-92c7-998cffae2295 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '.version_select at 0x7f4834c0af70>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:46.799405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2b73a5d0-d3d8-4e3f-92c7-998cffae2295 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838623671" status: 202 len: 0 microversion: 2.1 time: 0.023117 Sep 09 20:33:46.800007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 348/705] 10.222.0.26 () {58 vars in 1221 bytes} [Fri Sep 9 20:33:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838623671 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:33:46.856903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:46.865895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:46.867347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:46.868509 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-671a52d9-7f61-4977-87b4-f95db388b9e6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1665 microversion: 2.20 time: 0.157602 Sep 09 20:33:46.869064 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 358/706] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:46 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:46.892740 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e6407d0-69b3-44e9-bf59-7ab1b6727ba1"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:46.895035 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:46.901600 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:46.902293 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:46.902728 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:46.903412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:46.903861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:46.904280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:47.227988 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-893dd374-4545-4992-966f-282a34414bb6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.339087 Sep 09 20:33:47.228599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 349/707] 10.222.0.26 () {62 vars in 1364 bytes} [Fri Sep 9 20:33:46 2022] POST /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:33:47.354544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:47.355035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:47.361673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:47.362145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:47.362574 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:47.363256 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:47.363699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:47.364123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:47.597049 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dbd4cef1-d86e-48d2-8cf1-a997f1c95ded tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-volume_attachments/4e6407d0-69b3-44e9-bf59-7ab1b6727ba1" status: 202 len: 0 microversion: 2.20 time: 0.246403 Sep 09 20:33:47.597820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 359/708] 10.222.0.26 () {60 vars in 1457 bytes} [Fri Sep 9 20:33:47 2022] DELETE /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-volume_attachments/4e6407d0-69b3-44e9-bf59-7ab1b6727ba1 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:33:47.658529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:33:47.659051 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:47.665590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:47.666031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:47.666463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:47.667157 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:47.667747 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:47.668122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:47.698016 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120680) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 20:33:47.765662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5979f2d4-4af4-498a-84dd-90bed625c3ec tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "POST /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/action" status: 202 len: 0 microversion: 2.20 time: 0.111088 Sep 09 20:33:47.766335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 350/709] 10.222.0.26 () {62 vars in 1319 bytes} [Fri Sep 9 20:33:47 2022] POST /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:33:47.774347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:47.774955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:47.781930 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:47.782405 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:47.782837 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:47.783526 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:47.783970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:47.784388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:47.918931 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:47.927469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:47.929073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:47.930309 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-82af5e6b-a721-4f53-839b-e8329261f941 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1673 microversion: 2.20 time: 0.159890 Sep 09 20:33:47.930964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 360/710] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:47 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:48.955555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:48.956179 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:48.962516 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:48.962990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:48.963423 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:48.964097 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:48.964541 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:48.964954 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:49.094673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:49.102750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:49.104185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:49.105364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-32f4c39c-a8c3-424a-8a56-f19a26baaf89 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.153701 Sep 09 20:33:49.105918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 351/711] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:48 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:49.715102 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:49.715618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:49.723499 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:49.723984 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:49.724420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:49.725133 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:49.725593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:49.726017 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:49.740382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] HTTP exception thrown: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Request method failure captured: Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f HTTP/1.1 Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6HayXe9FnQ3-Xd62JpzW7BxAg1hi5j_CJEOcR7I8r6Jc601vxkg4n9ZBdD7QfFzuP9uhRnTGNS5k9ArRcPbK1YNtFfavm883F_LC9lNp4i9Y9aqVEry_jivRI1hVjS6EV58qezFYWpR2lKCBWnFTSmxwNekfRtLmRZNYVuJwPTmL1k Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:33:49.741982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 95bc48b6541c4388b45435036a1c4525 Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.743597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': 'e208f300-e8f3-44d5-9b42-27b8815e811f'} Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:49.744495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.745772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.747514 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Returning 404 to user: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:49.747514 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-632ec36f-fe9c-44ee-a58f-c292ef5c4c1e tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 404 len: 111 microversion: 2.1 time: 0.032079 Sep 09 20:33:49.747514 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 361/712] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:33:49 2022] DELETE /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:33:49.751926 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:49.752538 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: e208f300-e8f3-44d5-9b42-27b8815e811f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:49.758541 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:49.759019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:49.759456 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:49.760174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:49.760628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:49.761055 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:49.774373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] HTTP exception thrown: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Request method failure captured: Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f HTTP/1.1 Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HayXe9FnQ3-Xd62JpzW7BxAg1hi5j_CJEOcR7I8r6Jc601vxkg4n9ZBdD7QfFzuP9uhRnTGNS5k9ArRcPbK1YNtFfavm883F_LC9lNp4i9Y9aqVEry_jivRI1hVjS6EV58qezFYWpR2lKCBWnFTSmxwNekfRtLmRZNYVuJwPTmL1k Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:33:49.775953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 95bc48b6541c4388b45435036a1c4525 Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.778918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'e208f300-e8f3-44d5-9b42-27b8815e811f'} Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:49.779937 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. Sep 09 20:33:49.782143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:49.784099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Returning 404 to user: Instance e208f300-e8f3-44d5-9b42-27b8815e811f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:49.784099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ecf9e7ad-7591-4099-9cd2-c2ff67b37fbb tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f" status: 404 len: 111 microversion: 2.1 time: 0.029328 Sep 09 20:33:49.784099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 352/713] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:49 2022] GET /compute/v2.1/servers/e208f300-e8f3-44d5-9b42-27b8815e811f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:33:50.131703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:50.132310 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:50.141516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:50.143731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:50.144329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:50.147248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:50.147865 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:50.148474 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:50.336428 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:50.346144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:50.348331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:50.349826 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-135ac633-d134-45a6-9e58-dc19c07e7c11 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.222175 Sep 09 20:33:50.351159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 362/714] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:50 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:50.915843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:50.916357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:50.918884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:50.926601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:50.927187 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:50.927756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:50.928616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:50.929100 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:50.929549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:50.945013 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] HTTP exception thrown: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Request method failure captured: Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec HTTP/1.1 Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HayXe9FnQ3-Xd62JpzW7BxAg1hi5j_CJEOcR7I8r6Jc601vxkg4n9ZBdD7QfFzuP9uhRnTGNS5k9ArRcPbK1YNtFfavm883F_LC9lNp4i9Y9aqVEry_jivRI1hVjS6EV58qezFYWpR2lKCBWnFTSmxwNekfRtLmRZNYVuJwPTmL1k Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:33:50.946661 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 95bc48b6541c4388b45435036a1c4525 Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.948430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '7e0ef033-9a7a-4b4d-8c77-2e52b202adec'} Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:50.949352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.950834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.952315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Returning 404 to user: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:50.952315 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20caf70b-43d2-4a97-ac57-ec4f047e43f2 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 404 len: 111 microversion: 2.1 time: 0.036377 Sep 09 20:33:50.953127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 353/715] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:33:50 2022] DELETE /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:33:50.957796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:50.958408 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] [instance: 7e0ef033-9a7a-4b4d-8c77-2e52b202adec] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:50.964985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:50.965521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:50.965953 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:50.966649 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:50.967094 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:50.967511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:50.983527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] HTTP exception thrown: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Request method failure captured: Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec HTTP/1.1 Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6HayXe9FnQ3-Xd62JpzW7BxAg1hi5j_CJEOcR7I8r6Jc601vxkg4n9ZBdD7QfFzuP9uhRnTGNS5k9ArRcPbK1YNtFfavm883F_LC9lNp4i9Y9aqVEry_jivRI1hVjS6EV58qezFYWpR2lKCBWnFTSmxwNekfRtLmRZNYVuJwPTmL1k Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:33:50.985410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b310c05b03394f11b63f0a28f13d67b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: b310c05b03394f11b63f0a28f13d67b6 Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1532484780 Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 95bc48b6541c4388b45435036a1c4525 Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeTestJSON-1532484780-project Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.987211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '7e0ef033-9a7a-4b4d-8c77-2e52b202adec'} Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:33:50.988128 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. Sep 09 20:33:50.989672 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:33:50.991621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] Returning 404 to user: Instance 7e0ef033-9a7a-4b4d-8c77-2e52b202adec could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:33:50.991621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e0dfc6c-249c-4d6a-b5df-2b6d49669b64 tempest-AttachVolumeTestJSON-1532484780 tempest-AttachVolumeTestJSON-1532484780-project] 10.222.0.26 "GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec" status: 404 len: 111 microversion: 2.1 time: 0.033080 Sep 09 20:33:50.991621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 363/716] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:33:50 2022] GET /compute/v2.1/servers/7e0ef033-9a7a-4b4d-8c77-2e52b202adec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:33:51.380188 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:51.381032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:51.393175 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:51.393699 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:51.394279 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:51.394991 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:51.395442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:51.395868 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:51.638837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:51.647322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:51.649135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:51.650411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0245bad6-b88b-465b-bc75-9d79a26f2156 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.274501 Sep 09 20:33:51.651103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 354/717] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:51 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:33:52.677784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:52.678387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:52.688816 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:52.696750 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:52.697236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:52.697982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:52.698469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:52.698896 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:52.870985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:52.881676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:52.883502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:52.885077 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc8f6421-3243-42cf-bd82-841a2a3f9c3d tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.211183 Sep 09 20:33:52.885969 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 364/718] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:52 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:53.912658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:53.913106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:53.920536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:53.921836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:53.922441 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:53.923317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:53.923905 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:53.924476 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:54.503296 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:54.523605 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:54.525266 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:54.540121 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e05a9ee8-7747-4520-b013-81c22c37753b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.618834 Sep 09 20:33:54.541073 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 355/719] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:53 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:55.569126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:55.569825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:55.575464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:55.577897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:55.578397 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:55.579026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:55.579888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:55.580500 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:55.581106 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:55.768446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:55.777279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:55.779015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:55.786085 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-06968782-7834-4aaf-bdd1-bb84a3846b18 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.223747 Sep 09 20:33:55.794623 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 365/720] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:55 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:56.819821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:56.820725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:56.828061 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:56.828614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:56.829186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:56.830078 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:56.830838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:56.831336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:57.034101 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:57.037743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:33:57.044647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:57.047097 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:57.048468 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-59ff9a94-0c4e-44fd-940b-b6f85fac939b tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.232469 Sep 09 20:33:57.065277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 356/721] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:56 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:58.075872 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:58.076484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:58.083784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:58.084272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:58.084752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:58.085425 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:58.086019 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:58.086291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:58.227902 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:58.236964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:58.238459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:58.239617 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a01b24c-2556-4745-a628-d60023cf3541 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.167733 Sep 09 20:33:58.240327 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 366/722] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:58 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:33:59.267702 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:33:59.268789 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:33:59.276026 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:59.276510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:59.276952 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:59.277668 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:33:59.278128 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:33:59.278553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:33:59.417218 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:59.428879 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:59.430340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:33:59.431588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d43317b8-9d30-49b2-b47b-18db6bd7bb96 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.169573 Sep 09 20:33:59.432127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 357/723] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:33:59 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:00.458134 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:00.458747 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:00.465138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:00.465659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:00.466096 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:00.466910 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:00.468134 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:00.468742 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:00.603143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:00.611578 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:00.613327 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:00.614499 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be70f2f8-d645-40c8-8ae7-728eee626027 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.160307 Sep 09 20:34:00.615066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 367/724] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:00 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:01.638871 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:01.639633 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:01.646140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:01.646616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:01.647063 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:01.647717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:01.648166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:01.648578 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:01.772377 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:01.780834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:01.782292 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:01.783444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a8d73788-f700-449a-8bbf-a790d901f241 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.148487 Sep 09 20:34:01.783987 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 358/725] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:01 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:02.403962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-011fdce2-0a9c-4062-91ac-ab48327360ea req-2bf6e810-b2b6-495e-b057-94fddad0397d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85693f6-363f-443c-a6db-0db004b654ae", "name": "network-vif-plugged", "status": "completed", "tag": "dc8afa85-2831-4191-870d-42e15a736429"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:02.414217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-011fdce2-0a9c-4062-91ac-ab48327360ea req-2bf6e810-b2b6-495e-b057-94fddad0397d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:02.414651 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-011fdce2-0a9c-4062-91ac-ab48327360ea req-2bf6e810-b2b6-495e-b057-94fddad0397d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:02.415238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-011fdce2-0a9c-4062-91ac-ab48327360ea req-2bf6e810-b2b6-495e-b057-94fddad0397d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:02.426465 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-011fdce2-0a9c-4062-91ac-ab48327360ea req-2bf6e810-b2b6-495e-b057-94fddad0397d service nova] Creating event network-vif-plugged:dc8afa85-2831-4191-870d-42e15a736429 for instance e85693f6-363f-443c-a6db-0db004b654ae on hv-cinder-84932 Sep 09 20:34:02.431382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-011fdce2-0a9c-4062-91ac-ab48327360ea req-2bf6e810-b2b6-495e-b057-94fddad0397d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161495 Sep 09 20:34:02.431954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 368/726] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:02.809050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:02.809675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:02.816512 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:02.816991 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:02.817470 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:02.818151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:02.818601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:02.819021 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:02.960392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:02.968850 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:02.970684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:02.971550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a9a680bc-90e5-4b99-a6b4-a092f51cbea8 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.166362 Sep 09 20:34:02.972125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 359/727] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:02 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:03.998256 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:03.999742 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:04.006611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:04.007097 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:04.007726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:04.008791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:04.009418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:04.009847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:04.172915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:04.183050 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:04.184506 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:04.185697 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d4708b66-9b43-4063-8530-fc9b5d86c5b7 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1731 microversion: 2.20 time: 0.191849 Sep 09 20:34:04.186436 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 369/728] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:03 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:05.210017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:05.210621 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:05.218887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:05.219375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:05.219814 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:05.220510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:05.220962 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:05.221416 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:05.356646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:05.363171 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:05.364616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:05.365844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8a50f44e-64a5-4fd2-86ea-f13fbb3e2073 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1718 microversion: 2.20 time: 0.159613 Sep 09 20:34:05.366395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 360/729] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:05 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:15.771445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:15.771983 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:15.774473 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=9 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:15.775115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:15.782061 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:15.782541 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:15.782976 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:15.783669 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:15.784119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:15.784538 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:15.807859 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8aa2049c-fdde-4af3-a70d-693616c13286 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/ips" status: 200 len: 149 microversion: 2.1 time: 0.041014 Sep 09 20:34:15.808419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 370/730] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:34:15 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:17.187164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce20fabf-ca2d-4a93-a597-eea9e25e0776"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:17.189655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:17.192117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=15 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:17.192758 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=24 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:17.198391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:17.198864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:17.199323 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:17.199997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:17.200442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:17.200876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:17.438889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cdf9fc68-40a4-42c6-bfa7-0db7328b1344 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255770 Sep 09 20:34:17.439502 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 361/731] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:34:17 2022] POST /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:23.929099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-70fa4cdd-b675-4756-ae71-c6a6480d14ae tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: .version_select at 0x7f48349724c0>, body: {"keypair": {"name": "tempest-keypair-1748647056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz3HK6qvxrEAWS0eM1JmQmeUk2mTMXC48Punlw0dSAHgTO9I1a5nXFMTW49XojAovz4JYcHm9dSdNc3jLQgiAI5SNLT6j0XEZcCiNN4YsoKAHnVlvMbMcnJFQmE22F+OQ=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:23.944102 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-70fa4cdd-b675-4756-ae71-c6a6480d14ae tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:34:23.948182 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-70fa4cdd-b675-4756-ae71-c6a6480d14ae tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:34:23.970011 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-70fa4cdd-b675-4756-ae71-c6a6480d14ae tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045500 Sep 09 20:34:23.970540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 371/732] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:34:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:25.245376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-393408199", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acf3cd1a-b4b0-4a34-82b2-e2951d096a8f"}], "security_groups": [{"name": "tempest-securitygroup--607837563"}], "key_name": "tempest-keypair-1748647056", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:25.351580 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] validate_networks() for [('acf3cd1a-b4b0-4a34-82b2-e2951d096a8f', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:34:25.838708 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:34:25.839211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:34:25.839753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:34:25.840318 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:34:25.841358 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:34:25.851537 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:25.852021 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:25.852454 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:25.853176 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:25.853859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:25.854285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:25.871992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:34:25.876179 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:34:25.887350 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:34:25.889842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:34:25.935905 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-756f0a9a-9f2b-463d-9004-11008629462b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.695288 Sep 09 20:34:25.936552 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 362/733] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:34:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:34:25.947577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8870910e-6c5a-46ec-acd5-0029682528f7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:25.948295 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8870910e-6c5a-46ec-acd5-0029682528f7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:25.951829 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:26.007081 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8870910e-6c5a-46ec-acd5-0029682528f7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:26.014958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8870910e-6c5a-46ec-acd5-0029682528f7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1241 microversion: 2.1 time: 0.071235 Sep 09 20:34:26.015723 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 372/734] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:25 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:27.039932 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:27.040645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:27.054191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:27.054807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:27.055249 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:27.055951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:27.056402 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:27.056820 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:27.127232 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:27.135793 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fda03d00-fbb6-4331-9007-d525be75228b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1311 microversion: 2.1 time: 0.099909 Sep 09 20:34:27.136365 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 363/735] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:27 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:28.174748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:28.175612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:28.188614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:28.189037 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:28.189396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:28.190309 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:28.191462 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:28.192542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:28.361203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:28.371664 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c57beaec-602e-4e75-b09c-f97cb1fc969d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1366 microversion: 2.1 time: 0.213359 Sep 09 20:34:28.372553 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 373/736] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:28 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:28.929563 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-6b835e1c-ef31-4f99-b0f6-785d2b5bd85c req-d5c965ae-2afb-4971-a343-b04305886e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd0fa94-e842-4150-9939-37899a89da44", "tag": "5f45cfd7-522f-4633-8ade-6cd0aefcd5c3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:28.944750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6b835e1c-ef31-4f99-b0f6-785d2b5bd85c req-d5c965ae-2afb-4971-a343-b04305886e3e service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:28.945360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6b835e1c-ef31-4f99-b0f6-785d2b5bd85c req-d5c965ae-2afb-4971-a343-b04305886e3e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:28.945864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-6b835e1c-ef31-4f99-b0f6-785d2b5bd85c req-d5c965ae-2afb-4971-a343-b04305886e3e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:28.957437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-6b835e1c-ef31-4f99-b0f6-785d2b5bd85c req-d5c965ae-2afb-4971-a343-b04305886e3e service nova] Creating event network-changed:5f45cfd7-522f-4633-8ade-6cd0aefcd5c3 for instance 9dd0fa94-e842-4150-9939-37899a89da44 on hv-cinder-84932 Sep 09 20:34:28.962744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-6b835e1c-ef31-4f99-b0f6-785d2b5bd85c req-d5c965ae-2afb-4971-a343-b04305886e3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044615 Sep 09 20:34:28.963579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 364/737] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:29.395319 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:29.395960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:29.402411 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:29.402895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:29.403381 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:29.404638 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:29.405087 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:29.405530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:29.541786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:29.549589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-faf96769-fbe0-4e7b-9fb6-1186d1b8ec87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1366 microversion: 2.1 time: 0.158154 Sep 09 20:34:29.550151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 374/738] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:29 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:30.575093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:30.576425 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:30.582791 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:30.583206 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:30.583644 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:30.584398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:30.584855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:30.585311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:30.745651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:30.753556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f93c7ed5-1e0e-4ef3-b4ce-83e8092425eb tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1366 microversion: 2.1 time: 0.183307 Sep 09 20:34:30.754360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 365/739] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:30 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:31.777107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:31.777745 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:31.784588 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:31.785057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:31.785527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:31.786201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:31.786645 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:31.787057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:31.918876 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:31.927368 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dc665455-513c-4f44-9f36-c58e091a1de7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1366 microversion: 2.1 time: 0.154119 Sep 09 20:34:31.928041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 375/740] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:31 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:32.514233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-1fa68a98-77af-4eb0-a1bd-2d73f80f08cc req-b2b50dd7-31c3-4606-970c-1044ee9e45ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd0fa94-e842-4150-9939-37899a89da44", "name": "network-vif-plugged", "status": "completed", "tag": "5f45cfd7-522f-4633-8ade-6cd0aefcd5c3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:32.524373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1fa68a98-77af-4eb0-a1bd-2d73f80f08cc req-b2b50dd7-31c3-4606-970c-1044ee9e45ec service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:32.525588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1fa68a98-77af-4eb0-a1bd-2d73f80f08cc req-b2b50dd7-31c3-4606-970c-1044ee9e45ec service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:32.526085 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-1fa68a98-77af-4eb0-a1bd-2d73f80f08cc req-b2b50dd7-31c3-4606-970c-1044ee9e45ec service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:32.538498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-1fa68a98-77af-4eb0-a1bd-2d73f80f08cc req-b2b50dd7-31c3-4606-970c-1044ee9e45ec service nova] Creating event network-vif-plugged:5f45cfd7-522f-4633-8ade-6cd0aefcd5c3 for instance 9dd0fa94-e842-4150-9939-37899a89da44 on hv-cinder-84932 Sep 09 20:34:32.543470 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-1fa68a98-77af-4eb0-a1bd-2d73f80f08cc req-b2b50dd7-31c3-4606-970c-1044ee9e45ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033531 Sep 09 20:34:32.544262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 366/741] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:32.948950 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:32.949589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:32.955918 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:32.956395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:32.956831 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:32.957548 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:32.957995 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:32.958416 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:33.084736 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:33.092289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2115dcb9-6918-4427-844b-66a3beab0e20 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1366 microversion: 2.1 time: 0.147243 Sep 09 20:34:33.092852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 376/742] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:32 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:34.116490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:34.117194 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:34.124267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:34.124741 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:34.125167 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:34.125870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:34.126316 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:34.126735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:34.258474 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:34.267202 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a4b1a038-1a70-4d11-a4a0-41a9cfbfce05 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1366 microversion: 2.1 time: 0.155398 Sep 09 20:34:34.267950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 367/743] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:34 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:35.290575 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:35.291115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:35.297506 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:35.297979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:35.298405 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:35.299076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:35.299516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:35.299936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:35.425540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:35.433034 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b1784013-7fb1-4a4f-87f8-a84a1d7abbf1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1555 microversion: 2.1 time: 0.146364 Sep 09 20:34:35.433638 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 377/744] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:34:35 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:35.456571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:35.457080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:35.463395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:35.463870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:35.464360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:35.465042 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:35.465520 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:35.465946 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:35.540478 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cedb61be-2277-4f5e-a533-52395d598aa3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087727 Sep 09 20:34:35.541119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 368/745] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:34:35 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:36.472184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:36.588216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a42593da-245f-49c1-9cbe-0d3c5af5e40c req-5e8e6bcc-7890-4c64-a28b-14baa43fd0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd0fa94-e842-4150-9939-37899a89da44", "tag": "5f45cfd7-522f-4633-8ade-6cd0aefcd5c3"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:36.597828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a42593da-245f-49c1-9cbe-0d3c5af5e40c req-5e8e6bcc-7890-4c64-a28b-14baa43fd0c0 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:36.598302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a42593da-245f-49c1-9cbe-0d3c5af5e40c req-5e8e6bcc-7890-4c64-a28b-14baa43fd0c0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:36.598724 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a42593da-245f-49c1-9cbe-0d3c5af5e40c req-5e8e6bcc-7890-4c64-a28b-14baa43fd0c0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:36.610192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a42593da-245f-49c1-9cbe-0d3c5af5e40c req-5e8e6bcc-7890-4c64-a28b-14baa43fd0c0 service nova] Creating event network-changed:5f45cfd7-522f-4633-8ade-6cd0aefcd5c3 for instance 9dd0fa94-e842-4150-9939-37899a89da44 on hv-cinder-84932 Sep 09 20:34:36.615425 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a42593da-245f-49c1-9cbe-0d3c5af5e40c req-5e8e6bcc-7890-4c64-a28b-14baa43fd0c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147636 Sep 09 20:34:36.616388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 378/746] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:43.790513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:43.791320 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:43.796150 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:43.798364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:43.805079 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:43.805583 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:43.806014 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:43.806690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:43.807135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:43.807555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:43.836957 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e92529fe-2513-4e75-bd85-56b544bbd81a tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047227 Sep 09 20:34:43.837544 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 369/747] 10.222.0.26 () {60 vars in 1343 bytes} [Fri Sep 9 20:34:43 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:34:43.900530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:43.901114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:43.907211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:43.907691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:43.908125 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:43.908812 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:43.909289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:43.909715 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:43.933775 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:34:44.007628 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e5125817-708e-4b79-9cc7-3f1a7659b3b3 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 204 len: 0 microversion: 2.20 time: 0.111539 Sep 09 20:34:44.008214 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 379/748] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Sep 9 20:34:43 2022] DELETE /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 20:34:44.017028 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:44.017725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:44.024840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:44.025349 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:44.025785 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:44.026471 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:44.026921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:44.027342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:44.158725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:44.167575 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:44.169101 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:44.170275 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c601bd65-92c8-485f-9cce-26dfb9707de6 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.157595 Sep 09 20:34:44.171047 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 370/749] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:44 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:45.197854 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:45.198584 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:45.205788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:45.206364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:45.206866 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:45.207572 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:45.208030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:45.208457 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:45.356021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:45.364713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:45.366235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:45.367616 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9ec7f8e2-8e12-49f6-aa66-341af2973199 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1724 microversion: 2.20 time: 0.174084 Sep 09 20:34:45.368172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 380/750] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:45 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:46.330457 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-19a7f91a-bfa2-4a63-8b05-15d7b9373f57 req-292d05e0-34a1-4c62-8764-2efb546b934c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85693f6-363f-443c-a6db-0db004b654ae", "name": "network-vif-deleted", "tag": "dc8afa85-2831-4191-870d-42e15a736429"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:34:46.343299 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-19a7f91a-bfa2-4a63-8b05-15d7b9373f57 req-292d05e0-34a1-4c62-8764-2efb546b934c service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:46.343783 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-19a7f91a-bfa2-4a63-8b05-15d7b9373f57 req-292d05e0-34a1-4c62-8764-2efb546b934c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:46.344412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-19a7f91a-bfa2-4a63-8b05-15d7b9373f57 req-292d05e0-34a1-4c62-8764-2efb546b934c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:46.358240 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-19a7f91a-bfa2-4a63-8b05-15d7b9373f57 req-292d05e0-34a1-4c62-8764-2efb546b934c service nova] Creating event network-vif-deleted:dc8afa85-2831-4191-870d-42e15a736429 for instance e85693f6-363f-443c-a6db-0db004b654ae on hv-cinder-84932 Sep 09 20:34:46.364787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-19a7f91a-bfa2-4a63-8b05-15d7b9373f57 req-292d05e0-34a1-4c62-8764-2efb546b934c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038410 Sep 09 20:34:46.365621 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 371/751] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:34:46.394289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:46.394964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:46.398105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:46.409815 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:46.410833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:46.414970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:46.416234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:46.416879 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:46.417717 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:46.463843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:46.464483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:46.464895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:46.465369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lazy-loading 'fault' on Instance uuid e85693f6-363f-443c-a6db-0db004b654ae {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:34:46.515697 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:46.526516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:46.527960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db1f365ebf794941b3999adb37c48100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c1c909559e44322a07f7e4a463424a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:34:46.530664 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-79c9f1db-b69e-41b3-873a-839a32e9c141 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 200 len: 1371 microversion: 2.20 time: 0.141113 Sep 09 20:34:46.533388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 381/752] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:46 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:34:47.557290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:47.558100 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:47.560935 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:47.566919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:47.567402 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:47.567840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:47.568536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:47.568987 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:47.569446 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:47.572945 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:34:47.585306 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] HTTP exception thrown: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Request method failure captured: Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae HTTP/1.1 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HhtVvkR70a10IL4zVlC1rpu2TU6xWtEjv9xSzpj437gWdEI3u8ex2Mle8Yk9jr1KghHJJyFqMSwiPxJNjQKIGppF8AlcW46MD6RwrDNIwv_lScZncvLIf7pEmeJsAzMTejZyhR4I7VJnPuMmJXtNGWdPCwo_8yB9j3fI8CV3AJsI8 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:34:47.586924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: db1f365ebf794941b3999adb37c48100 Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:47.588627 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'e85693f6-363f-443c-a6db-0db004b654ae'} Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:34:47.589608 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:47.591675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:47.592981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Returning 404 to user: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:34:47.592981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9de3dbd-ac8d-4a1e-99d7-4d2abd557e42 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 404 len: 111 microversion: 2.20 time: 0.035370 Sep 09 20:34:47.592981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 372/753] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:47 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:34:47.598251 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8a2809d8-1c54-4e13-829b-1830dd098dd1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '.version_select at 0x7f48348ca8b0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:47.621029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8a2809d8-1c54-4e13-829b-1830dd098dd1 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229528076" status: 204 len: 0 microversion: 2.20 time: 0.026527 Sep 09 20:34:47.621636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 382/754] 10.222.0.26 () {60 vars in 1259 bytes} [Fri Sep 9 20:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229528076 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 20:34:49.383244 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:49.383735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:49.390646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:49.391159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:49.391721 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:49.392411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:49.392870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:49.393324 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:49.407128 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] HTTP exception thrown: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Request method failure captured: Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae HTTP/1.1 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HhtVvkR70a10IL4zVlC1rpu2TU6xWtEjv9xSzpj437gWdEI3u8ex2Mle8Yk9jr1KghHJJyFqMSwiPxJNjQKIGppF8AlcW46MD6RwrDNIwv_lScZncvLIf7pEmeJsAzMTejZyhR4I7VJnPuMmJXtNGWdPCwo_8yB9j3fI8CV3AJsI8 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:34:49.408729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: db1f365ebf794941b3999adb37c48100 Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.410380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'e85693f6-363f-443c-a6db-0db004b654ae'} Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:34:49.414173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.415638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.417125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Returning 404 to user: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:34:49.417125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4acb355b-c25a-429d-a665-f72a8b7f16e5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 404 len: 111 microversion: 2.20 time: 0.031041 Sep 09 20:34:49.417125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 373/755] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Sep 9 20:34:49 2022] DELETE /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:34:49.419833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:49.420465 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: e85693f6-363f-443c-a6db-0db004b654ae] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:49.427250 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:49.427726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:49.428160 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:49.428841 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:49.429308 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:49.429733 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:49.444338 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] HTTP exception thrown: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Request method failure captured: Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae HTTP/1.1 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6HhtVvkR70a10IL4zVlC1rpu2TU6xWtEjv9xSzpj437gWdEI3u8ex2Mle8Yk9jr1KghHJJyFqMSwiPxJNjQKIGppF8AlcW46MD6RwrDNIwv_lScZncvLIf7pEmeJsAzMTejZyhR4I7VJnPuMmJXtNGWdPCwo_8yB9j3fI8CV3AJsI8 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:34:49.446030 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: db1f365ebf794941b3999adb37c48100 Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.447710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': 'e85693f6-363f-443c-a6db-0db004b654ae'} Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:34:49.449999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. Sep 09 20:34:49.451426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:49.452768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Returning 404 to user: Instance e85693f6-363f-443c-a6db-0db004b654ae could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:34:49.452768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ce36615a-600c-4eb8-b7dd-804d49e8e6b5 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae" status: 404 len: 111 microversion: 2.20 time: 0.032619 Sep 09 20:34:49.452768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 383/756] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:49 2022] GET /compute/v2.1/servers/e85693f6-363f-443c-a6db-0db004b654ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:34:50.586154 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:50.586672 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:50.593498 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:50.593979 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:50.594408 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:50.595087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:50.595531 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:50.595947 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:50.609494 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] HTTP exception thrown: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Request method failure captured: Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f HTTP/1.1 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6HhtVvkR70a10IL4zVlC1rpu2TU6xWtEjv9xSzpj437gWdEI3u8ex2Mle8Yk9jr1KghHJJyFqMSwiPxJNjQKIGppF8AlcW46MD6RwrDNIwv_lScZncvLIf7pEmeJsAzMTejZyhR4I7VJnPuMmJXtNGWdPCwo_8yB9j3fI8CV3AJsI8 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:34:50.611258 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: db1f365ebf794941b3999adb37c48100 Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.612907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'abe125d2-51c7-4732-aa2a-90ab2d85d05f'} Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:34:50.613863 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.615421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.616919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Returning 404 to user: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:34:50.616919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-19641db1-ffe5-413d-8f7f-daa2b1a21277 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 404 len: 111 microversion: 2.20 time: 0.030361 Sep 09 20:34:50.616919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 374/757] 10.222.0.26 () {60 vars in 1280 bytes} [Fri Sep 9 20:34:50 2022] DELETE /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:34:50.621451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:34:50.622065 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] [instance: abe125d2-51c7-4732-aa2a-90ab2d85d05f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:34:50.628488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:50.628959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:50.629420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:50.630107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:34:50.630614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:34:50.631041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:34:50.644490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] HTTP exception thrown: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Request method failure captured: Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f HTTP/1.1 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6HhtVvkR70a10IL4zVlC1rpu2TU6xWtEjv9xSzpj437gWdEI3u8ex2Mle8Yk9jr1KghHJJyFqMSwiPxJNjQKIGppF8AlcW46MD6RwrDNIwv_lScZncvLIf7pEmeJsAzMTejZyhR4I7VJnPuMmJXtNGWdPCwo_8yB9j3fI8CV3AJsI8 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:34:50.646051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c1c909559e44322a07f7e4a463424a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 8c1c909559e44322a07f7e4a463424a5 Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-330625372 Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: db1f365ebf794941b3999adb37c48100 Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-330625372-project Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.647675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': 'abe125d2-51c7-4732-aa2a-90ab2d85d05f'} Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:34:50.648552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. Sep 09 20:34:50.650031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:34:50.651302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] Returning 404 to user: Instance abe125d2-51c7-4732-aa2a-90ab2d85d05f could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:34:50.651302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-782d7836-21e9-4627-84ee-8976b11e1b45 tempest-AttachVolumeShelveTestJSON-330625372 tempest-AttachVolumeShelveTestJSON-330625372-project] 10.222.0.26 "GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f" status: 404 len: 111 microversion: 2.20 time: 0.029995 Sep 09 20:34:50.651302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 384/758] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Sep 9 20:34:50 2022] GET /compute/v2.1/servers/abe125d2-51c7-4732-aa2a-90ab2d85d05f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:35:12.760146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:12.760675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:12.763031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=5 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:12.763674 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=5 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:12.769615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:12.770099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:12.770536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:12.771231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:12.771685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:12.772111 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:12.795746 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa8e81af-f9c0-44ff-945e-8f06dcc29c15 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44/ips" status: 200 len: 149 microversion: 2.1 time: 0.039526 Sep 09 20:35:12.796313 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 375/759] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:35:12 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:12.807853 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce20fabf-ca2d-4a93-a597-eea9e25e0776"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:12.810783 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:12.813451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:12.814225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:12.820118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:12.820600 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:12.821031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:12.821752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:12.822204 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:12.822625 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:12.901460 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Invalid volume: volume ce20fabf-ca2d-4a93-a597-eea9e25e0776 is already attached to instances: 85ad8e52-a548-49df-88d4-9969d1bcf873 Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44/os-volume_attachments HTTP/1.1 Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 74 Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:35:12.903058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {"volumeAttachment": {"volumeId": "ce20fabf-ca2d-4a93-a597-eea9e25e0776"}} Sep 09 20:35:12.904648 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Invalid volume: volume ce20fabf-ca2d-4a93-a597-eea9e25e0776 is already attached to instances: 85ad8e52-a548-49df-88d4-9969d1bcf873 Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'server_id': '9dd0fa94-e842-4150-9939-37899a89da44', 'body': {'volumeAttachment': {'volumeId': 'ce20fabf-ca2d-4a93-a597-eea9e25e0776'}}} Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce20fabf-ca2d-4a93-a597-eea9e25e0776 is already attached to instances: 85ad8e52-a548-49df-88d4-9969d1bcf873 Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:35:12.905654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce20fabf-ca2d-4a93-a597-eea9e25e0776 is already attached to instances: 85ad8e52-a548-49df-88d4-9969d1bcf873 Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:12.907184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce20fabf-ca2d-4a93-a597-eea9e25e0776 is already attached to instances: 85ad8e52-a548-49df-88d4-9969d1bcf873 Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 400 to user: Invalid volume: volume ce20fabf-ca2d-4a93-a597-eea9e25e0776 is already attached to instances: 85ad8e52-a548-49df-88d4-9969d1bcf873 {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bed37043-8d7a-4d59-8481-536c5cb688d2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100625 Sep 09 20:35:12.908999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 385/760] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:35:12 2022] POST /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:35:12.913217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:12.913736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:12.920163 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:12.920640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:12.921076 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:12.921791 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:12.922247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:12.922672 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:12.948373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Going to try to terminate instance {{(pid=120680) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:35:13.021882 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-36089561-8e1d-4730-87bc-a45053d35806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 204 len: 0 microversion: 2.1 time: 0.112162 Sep 09 20:35:13.022452 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 376/761] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:35:12 2022] DELETE /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:35:13.031009 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:13.031691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:13.038137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:13.038619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:13.039057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:13.039745 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:13.040204 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:13.040627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:13.169232 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:13.176944 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f81d3da2-9af7-4c9a-a23e-a4c032395985 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1680 microversion: 2.1 time: 0.150281 Sep 09 20:35:13.177540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 386/762] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:13 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:14.202248 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:14.202867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:14.210883 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:14.211365 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:14.211799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:14.212513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:14.213134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:14.213748 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:14.342126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:14.349680 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6fda7e4c-e2f2-46df-8ef0-f23928af96d0 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1680 microversion: 2.1 time: 0.152447 Sep 09 20:35:14.350239 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 377/763] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:14 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:15.375036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:15.375552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:15.382069 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:15.382543 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:15.382971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:15.383646 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:15.384095 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:15.384511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:15.510289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:15.518600 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62c10c47-d8c4-4f2c-8ddf-4b3fc3fb3a87 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1680 microversion: 2.1 time: 0.148089 Sep 09 20:35:15.519161 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 387/764] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:15 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:35:16.542262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:16.543376 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:16.549855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:16.550336 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:16.550771 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:16.551459 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:16.551917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:16.552341 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:16.681852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:16.690246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b65daeaa-19dc-4be1-b08d-cdb7814ec15b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1680 microversion: 2.1 time: 0.151928 Sep 09 20:35:16.690846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 378/765] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:16 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:17.713399 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:17.714004 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:17.720587 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:17.721053 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:17.721514 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:17.722184 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:17.722628 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:17.723040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:17.847675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:17.855144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ff5ba810-774b-40c7-8fd4-da84aa0d773c tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1680 microversion: 2.1 time: 0.145681 Sep 09 20:35:17.855702 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 388/766] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:17 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:18.766418 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f47baba1-e18e-4a47-a842-69774eaaf5e1 req-60b03f0e-d016-4d24-8f14-695da66ff580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd0fa94-e842-4150-9939-37899a89da44", "name": "network-vif-deleted", "tag": "5f45cfd7-522f-4633-8ade-6cd0aefcd5c3"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:18.775707 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f47baba1-e18e-4a47-a842-69774eaaf5e1 req-60b03f0e-d016-4d24-8f14-695da66ff580 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:18.776194 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f47baba1-e18e-4a47-a842-69774eaaf5e1 req-60b03f0e-d016-4d24-8f14-695da66ff580 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:18.776651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f47baba1-e18e-4a47-a842-69774eaaf5e1 req-60b03f0e-d016-4d24-8f14-695da66ff580 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:18.788272 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f47baba1-e18e-4a47-a842-69774eaaf5e1 req-60b03f0e-d016-4d24-8f14-695da66ff580 service nova] Creating event network-vif-deleted:5f45cfd7-522f-4633-8ade-6cd0aefcd5c3 for instance 9dd0fa94-e842-4150-9939-37899a89da44 on hv-cinder-84932 Sep 09 20:35:18.794020 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f47baba1-e18e-4a47-a842-69774eaaf5e1 req-60b03f0e-d016-4d24-8f14-695da66ff580 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031802 Sep 09 20:35:18.794775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 379/767] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:18.880404 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:18.881818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:18.890524 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:18.891548 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:18.892096 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:18.892929 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:18.893515 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:18.894073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:18.933148 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:18.933662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:18.934086 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:18.934535 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lazy-loading 'fault' on Instance uuid 9dd0fa94-e842-4150-9939-37899a89da44 {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:35:18.981411 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:18.991635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-75b0c7e2-66b9-4de5-bc92-71291d7fc5af tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 200 len: 1331 microversion: 2.1 time: 0.117042 Sep 09 20:35:18.993627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 389/768] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:18 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:20.018094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:20.018716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:20.024829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:20.025432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:20.025939 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:20.026624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:20.027124 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:20.027549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:20.040762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 HTTP/1.1 Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:35:20.042379 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:35:20.044080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '9dd0fa94-e842-4150-9939-37899a89da44'} Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:35:20.045120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:35:20.046713 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:20.048151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:35:20.048151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2647e99a-3c9e-4154-9527-db16cd6b3fe9 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 404 len: 111 microversion: 2.1 time: 0.030520 Sep 09 20:35:20.048151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 380/769] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:20 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:35:20.052668 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-56611d7e-21b8-452a-8494-d2ec6bc0f05b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '.version_select at 0x7f48348b79d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:20.072781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-56611d7e-21b8-452a-8494-d2ec6bc0f05b tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748647056" status: 202 len: 0 microversion: 2.1 time: 0.023830 Sep 09 20:35:20.073361 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 390/770] 10.222.0.26 () {58 vars in 1221 bytes} [Fri Sep 9 20:35:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748647056 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:35:20.722146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:20.722647 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:20.728470 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:20.728957 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:20.729432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:20.730157 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:20.730619 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:20.731039 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:20.815562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lazy-loading 'services' on Instance uuid 85ad8e52-a548-49df-88d4-9969d1bcf873 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:35:20.897104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d56aee79-9097-4cd6-b382-d2e86e576c59 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments/ce20fabf-ca2d-4a93-a597-eea9e25e0776" status: 202 len: 0 microversion: 2.1 time: 0.178693 Sep 09 20:35:20.897758 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 381/771] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:35:20 2022] DELETE /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments/ce20fabf-ca2d-4a93-a597-eea9e25e0776 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:35:20.911732 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:20.913959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:21.083276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:21.083994 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:21.084205 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:21.084923 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:21.085421 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:21.085850 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:21.116339 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e25fd10d-b67b-4422-b542-5bbdc7ed0066 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213952 Sep 09 20:35:21.116897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 391/772] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:35:20 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:22.131921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:22.134306 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:22.141919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:22.142591 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:22.144107 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:22.144816 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:22.145294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:22.145891 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:22.179840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e4ce418e-8b52-4546-9bf2-26c8634ff590 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053788 Sep 09 20:35:22.180488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 382/773] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:35:22 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:35:22.251721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:22.252272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:22.259048 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:22.259780 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:22.260380 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:22.261180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:22.261860 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:22.262278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:22.290067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:35:22.367567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-eec641c6-f8a4-478d-8891-1d1c7ca32dab tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 204 len: 0 microversion: 2.1 time: 0.119700 Sep 09 20:35:22.368146 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 392/774] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:35:22 2022] DELETE /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:35:22.377759 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:22.378533 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:22.384255 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:22.384726 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:22.385152 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:22.385884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:22.386329 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:22.386744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:22.513579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:22.521555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-01dcfeba-8bef-4a80-9dd3-db604a0ee7c2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1680 microversion: 2.1 time: 0.148242 Sep 09 20:35:22.522094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 383/775] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:22 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:23.546042 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:23.546536 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:23.552704 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:23.553083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:23.553544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:23.554237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:23.554721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:23.555147 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:23.696141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:23.704611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11eb0502-c93c-40bc-b8aa-8a0bfaabe7fd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1680 microversion: 2.1 time: 0.163112 Sep 09 20:35:23.705270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 393/776] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:23 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:24.728693 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:24.729952 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:24.737148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:24.737718 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:24.738302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:24.739109 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:24.739565 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:24.739981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:24.840521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:24.854195 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-47b1825f-be14-4863-8e5b-5270d6863f01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 200 len: 1613 microversion: 2.1 time: 0.129107 Sep 09 20:35:24.855129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 384/777] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:24 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 1613 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:24.877170 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2a4a4e99-1d05-40fa-9444-47691590cbda req-366876cc-082a-444e-9c88-5e4c94b4e513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ad8e52-a548-49df-88d4-9969d1bcf873", "name": "network-vif-deleted", "tag": "ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:24.907514 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a4a4e99-1d05-40fa-9444-47691590cbda req-366876cc-082a-444e-9c88-5e4c94b4e513 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:24.908397 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a4a4e99-1d05-40fa-9444-47691590cbda req-366876cc-082a-444e-9c88-5e4c94b4e513 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:24.908831 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a4a4e99-1d05-40fa-9444-47691590cbda req-366876cc-082a-444e-9c88-5e4c94b4e513 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:24.926657 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2a4a4e99-1d05-40fa-9444-47691590cbda req-366876cc-082a-444e-9c88-5e4c94b4e513 service nova] Creating event network-vif-deleted:ad572a26-4dd8-4abc-91ef-a9a4f9f3b0ba for instance 85ad8e52-a548-49df-88d4-9969d1bcf873 on hv-cinder-84932 Sep 09 20:35:24.932463 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2a4a4e99-1d05-40fa-9444-47691590cbda req-366876cc-082a-444e-9c88-5e4c94b4e513 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058887 Sep 09 20:35:24.934249 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 394/778] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:25.881064 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:25.884394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:25.903456 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:25.903956 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:25.904394 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:25.905166 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:25.906787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:25.907203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:25.925104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 HTTP/1.1 Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:35:25.926978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:35:25.928288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '85ad8e52-a548-49df-88d4-9969d1bcf873'} Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:35:25.929041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:35:25.930291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:35:25.931383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:35:25.931383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-fa9925b6-fd21-4414-9858-8be03fba69d3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 404 len: 111 microversion: 2.1 time: 0.052474 Sep 09 20:35:25.938619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-18990972-33a3-46e7-85b2-127a310988f2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '.version_select at 0x7f483494ef70>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:25.944447 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 385/779] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:25 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:35:25.961078 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-18990972-33a3-46e7-85b2-127a310988f2 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165947215" status: 202 len: 0 microversion: 2.1 time: 0.026733 Sep 09 20:35:25.961789 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 395/780] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Sep 9 20:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165947215 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:35:27.367532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-1d4ad543-db02-42bc-a2ff-c543d6b69837 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: .version_select at 0x7f4834ac2dc0>, body: {"keypair": {"name": "tempest-keypair-763175717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+0AJ2cZYOocc6vVZj+rtX90wVXh0V1YdaZnXmkp4zktooln0YE6A1kfywJN+SWQ5E5vEiHEoV1AZ6UWCyPBt9/zEg7rfJPGFsxNChSVXpUBukyjCBNLXRPwXtnCJSq+g=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:27.387619 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-1d4ad543-db02-42bc-a2ff-c543d6b69837 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:35:27.392202 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-1d4ad543-db02-42bc-a2ff-c543d6b69837 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:35:27.429567 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-1d4ad543-db02-42bc-a2ff-c543d6b69837 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065659 Sep 09 20:35:27.437547 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 386/781] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:35:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:29.256974 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1172514419", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acf3cd1a-b4b0-4a34-82b2-e2951d096a8f"}], "security_groups": [{"name": "tempest-securitygroup--8721821"}], "key_name": "tempest-keypair-763175717", "user_data": "}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:29.482418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] validate_networks() for [('acf3cd1a-b4b0-4a34-82b2-e2951d096a8f', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:35:30.113523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:35:30.114164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:35:30.114800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:35:30.115667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:35:30.116247 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:35:30.128832 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:30.129772 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:30.130370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:30.132040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:30.132883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:30.133960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:30.155193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:35:30.165001 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:35:30.186452 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:35:30.189083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:35:30.273364 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8ad80707-31aa-4599-8a39-eda11332a272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.021387 Sep 09 20:35:30.282109 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 396/782] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:35:29 2022] POST /compute/v2.1/servers => generated 399 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:35:30.287518 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-277bab75-c0c9-4097-ab1b-13c0d6fdf257 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:30.290756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-277bab75-c0c9-4097-ab1b-13c0d6fdf257 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:30.457980 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-277bab75-c0c9-4097-ab1b-13c0d6fdf257 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:30.483333 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-277bab75-c0c9-4097-ab1b-13c0d6fdf257 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1241 microversion: 2.1 time: 0.200191 Sep 09 20:35:30.487610 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 387/783] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:30 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:31.512259 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:31.512875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:31.522124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:31.523764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:31.524490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:31.525845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:31.527107 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:31.527804 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:31.637143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:31.675601 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aac60e7f-93bd-4b52-a1ec-9cbc1b823b18 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1293 microversion: 2.1 time: 0.169477 Sep 09 20:35:31.679255 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 397/784] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:31 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:32.720019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:32.720634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:32.730816 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:32.732588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:32.733232 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:32.734227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:32.735172 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:32.735833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:33.067936 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:33.080440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ad3f18d5-87ea-4cbc-9a5f-a3d3818f1a29 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1364 microversion: 2.1 time: 0.371758 Sep 09 20:35:33.081658 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 388/785] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:32 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:33.695278 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-955110d5-3782-4bb1-96f6-5527d7bfa03d req-4ebf2f01-0bc2-4751-b23f-12e96ceba3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79c57c8-9531-4ddb-9c45-ab13ce2198fc", "tag": "ddf6e429-ad62-4521-b729-5b52421bc743"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:33.723172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-955110d5-3782-4bb1-96f6-5527d7bfa03d req-4ebf2f01-0bc2-4751-b23f-12e96ceba3c8 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:33.725510 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-955110d5-3782-4bb1-96f6-5527d7bfa03d req-4ebf2f01-0bc2-4751-b23f-12e96ceba3c8 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:33.726162 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-955110d5-3782-4bb1-96f6-5527d7bfa03d req-4ebf2f01-0bc2-4751-b23f-12e96ceba3c8 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:33.741397 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-955110d5-3782-4bb1-96f6-5527d7bfa03d req-4ebf2f01-0bc2-4751-b23f-12e96ceba3c8 service nova] Creating event network-changed:ddf6e429-ad62-4521-b729-5b52421bc743 for instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc on hv-cinder-84932 Sep 09 20:35:33.747493 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-955110d5-3782-4bb1-96f6-5527d7bfa03d req-4ebf2f01-0bc2-4751-b23f-12e96ceba3c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057970 Sep 09 20:35:33.748682 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 398/786] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:34.104524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:34.106275 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:34.124044 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:34.124710 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:34.125268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:34.126325 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:34.126849 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:34.127364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:34.402075 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:34.422996 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b25a542c-dac9-48a7-8db5-37b96b2f7ea4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1364 microversion: 2.1 time: 0.322163 Sep 09 20:35:34.432165 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 389/787] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:34 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:35.460105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:35.460687 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:35.481821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:35.484673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:35.485623 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:35.486765 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:35.490951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:35.491787 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:35.759593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:35.782752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-20b46e86-f5d3-45ee-b5b3-4ebaade6c062 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1364 microversion: 2.1 time: 0.327952 Sep 09 20:35:35.783314 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 399/788] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:35 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:36.806685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:36.808628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:36.826603 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:36.829562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:36.830211 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:36.831265 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:36.832653 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:36.833350 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:37.063692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:37.080998 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ec1dec8-55e7-40f8-ab28-d493697697b4 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1364 microversion: 2.1 time: 0.273043 Sep 09 20:35:37.094381 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 390/789] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:36 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:38.038849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f42579a1-d5fb-4319-affd-e4af7f49c2a4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Action: 'create', calling method: .version_select at 0x7f4834a8ef70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1370114658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQtzTzAL1V7H+II94djHSMkFLLziidxNjX6FOe80j9nDblG8y8Czmo4j2G4kMi+jrk3Scxc5uoWKviRjXAUETty5rFNtRVnDjx81wJiatS6gteQkZmN2OhznFg0bZRtSg=="}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:38.054791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-f42579a1-d5fb-4319-affd-e4af7f49c2a4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:35:38.059869 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-f42579a1-d5fb-4319-affd-e4af7f49c2a4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for user 63371d392c8c4b73939ee73a1627c8dd and project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'key_pairs'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:35:38.084836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f42579a1-d5fb-4319-affd-e4af7f49c2a4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.224062 Sep 09 20:35:38.085394 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 400/790] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:35:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:38.107837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:38.109091 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:38.116782 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:38.117340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:38.117829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:38.123179 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:38.124414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:38.125102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:38.341948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:38.350229 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ed6af8be-a8c4-423f-ab01-132bcc5c0139 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1364 microversion: 2.1 time: 0.248188 Sep 09 20:35:38.351921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 391/791] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:38 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:38.719340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-3a207f01-ede1-4254-81a2-93c2e0a79f6d req-701635b2-7480-4be2-a34a-321f6b2226e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79c57c8-9531-4ddb-9c45-ab13ce2198fc", "name": "network-vif-plugged", "status": "completed", "tag": "ddf6e429-ad62-4521-b729-5b52421bc743"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:38.738090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3a207f01-ede1-4254-81a2-93c2e0a79f6d req-701635b2-7480-4be2-a34a-321f6b2226e6 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:38.739742 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3a207f01-ede1-4254-81a2-93c2e0a79f6d req-701635b2-7480-4be2-a34a-321f6b2226e6 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:38.740395 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-3a207f01-ede1-4254-81a2-93c2e0a79f6d req-701635b2-7480-4be2-a34a-321f6b2226e6 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:38.759856 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-3a207f01-ede1-4254-81a2-93c2e0a79f6d req-701635b2-7480-4be2-a34a-321f6b2226e6 service nova] Creating event network-vif-plugged:ddf6e429-ad62-4521-b729-5b52421bc743 for instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc on hv-cinder-84932 Sep 09 20:35:38.768787 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-3a207f01-ede1-4254-81a2-93c2e0a79f6d req-701635b2-7480-4be2-a34a-321f6b2226e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052833 Sep 09 20:35:38.781600 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 401/792] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:35:39.379003 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:39.379792 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:39.395399 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:39.395966 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:39.396495 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:39.397354 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:39.397882 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:39.398380 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:39.572158 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:39.585949 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2f74fe0a-bf02-414b-8494-8c65191621ac tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1364 microversion: 2.1 time: 0.211674 Sep 09 20:35:39.587185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 392/793] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:39 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:35:40.614076 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:40.614952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:40.618158 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:40.625848 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:40.626341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:40.626774 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:40.627466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:40.627911 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:40.628521 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:40.766260 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:35:40.774496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-91bba1ee-c11d-4141-a21b-30595afea039 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1554 microversion: 2.1 time: 0.167341 Sep 09 20:35:40.775075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 402/794] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:40 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:35:40.800001 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:40.800583 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:40.802924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:40.808535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:40.809017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:40.809485 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:40.810171 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:40.810615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:40.811028 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:40.832707 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:40.913191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3a8b2ba9-760f-4312-a67b-6ab1c3afe488 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117329 Sep 09 20:35:40.925000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 393/795] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:35:40 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:42.249562 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-9273daa8-7949-43ff-ac48-e75aa358776f req-70feee8e-2652-4cac-8ff3-b1a12a44916d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79c57c8-9531-4ddb-9c45-ab13ce2198fc", "tag": "ddf6e429-ad62-4521-b729-5b52421bc743"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:42.260931 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9273daa8-7949-43ff-ac48-e75aa358776f req-70feee8e-2652-4cac-8ff3-b1a12a44916d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:42.261438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9273daa8-7949-43ff-ac48-e75aa358776f req-70feee8e-2652-4cac-8ff3-b1a12a44916d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:42.261882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-9273daa8-7949-43ff-ac48-e75aa358776f req-70feee8e-2652-4cac-8ff3-b1a12a44916d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:42.278570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-9273daa8-7949-43ff-ac48-e75aa358776f req-70feee8e-2652-4cac-8ff3-b1a12a44916d service nova] Creating event network-changed:ddf6e429-ad62-4521-b729-5b52421bc743 for instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc on hv-cinder-84932 Sep 09 20:35:42.285440 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-9273daa8-7949-43ff-ac48-e75aa358776f req-70feee8e-2652-4cac-8ff3-b1a12a44916d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040729 Sep 09 20:35:42.286842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 403/796] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:35:59.186715 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:59.190997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1985609345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1370114658", "security_groups": [{"name": "tempest-secgroup-smoke-1813791276"}], "block_device_mapping_v2": [{"uuid": "595fef32-9d38-43ab-bea5-0a71a6eeab99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59e2f46b-26f1-41b6-a478-bcc0b9346326"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:35:59.309384 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] validate_networks() for [('59e2f46b-26f1-41b6-a478-bcc0b9346326', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:35:59.688869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:35:59.689323 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:35:59.689803 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:35:59.690213 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:35:59.690628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:35:59.699378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:59.699856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:59.700288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:59.701015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:35:59.701496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:35:59.701921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:35:59.718787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:35:59.722693 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for user 63371d392c8c4b73939ee73a1627c8dd and project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:35:59.780782 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:35:59.783048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='595fef32-9d38-43ab-bea5-0a71a6eeab99',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:35:59.922577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82ae6fa9-0c1d-4076-b367-994547289173 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737250 Sep 09 20:35:59.923469 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 394/797] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:35:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:35:59.935069 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9cc5cb2a-b54b-4d4e-a037-686823772343 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:35:59.935663 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9cc5cb2a-b54b-4d4e-a037-686823772343 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:35:59.938038 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=10 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:59.938856 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:35:59.939789 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:00.011484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9cc5cb2a-b54b-4d4e-a037-686823772343 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:00.019276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9cc5cb2a-b54b-4d4e-a037-686823772343 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1095 microversion: 2.1 time: 0.088469 Sep 09 20:36:00.019963 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 404/798] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:35:59 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:01.044613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:01.046238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:01.055783 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:01.057533 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:01.058490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:01.059466 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:01.059940 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:01.060675 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:01.145294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:01.155609 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f986306f-e926-4faa-bccc-fa0c8bf9fef6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1201 microversion: 2.1 time: 0.117523 Sep 09 20:36:01.156321 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 395/799] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:01 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1201 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:02.185696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:02.186413 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:02.193273 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:02.193819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:02.194264 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:02.194959 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:02.195416 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:02.195845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:02.329118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:02.337576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b25a7119-e43e-42fe-9b34-124f5c3e6e98 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.156359 Sep 09 20:36:02.338615 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 405/800] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:02 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:02.460103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-11f57bc1-de58-4e1f-a71b-5d7f455fa88f req-45c22f51-147e-4e62-9ce2-6cd4fdeb6707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc57f22-97e2-44fc-88b3-f5d9f124636e", "tag": "581d55fb-fee5-444b-bc2c-64e00c4532de"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:02.473094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11f57bc1-de58-4e1f-a71b-5d7f455fa88f req-45c22f51-147e-4e62-9ce2-6cd4fdeb6707 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:02.473632 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11f57bc1-de58-4e1f-a71b-5d7f455fa88f req-45c22f51-147e-4e62-9ce2-6cd4fdeb6707 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:02.474069 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-11f57bc1-de58-4e1f-a71b-5d7f455fa88f req-45c22f51-147e-4e62-9ce2-6cd4fdeb6707 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:02.487642 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-11f57bc1-de58-4e1f-a71b-5d7f455fa88f req-45c22f51-147e-4e62-9ce2-6cd4fdeb6707 service nova] Creating event network-changed:581d55fb-fee5-444b-bc2c-64e00c4532de for instance ccc57f22-97e2-44fc-88b3-f5d9f124636e on hv-cinder-84932 Sep 09 20:36:02.493110 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-11f57bc1-de58-4e1f-a71b-5d7f455fa88f req-45c22f51-147e-4e62-9ce2-6cd4fdeb6707 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036564 Sep 09 20:36:02.494987 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 396/801] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:03.361797 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:03.362388 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:03.368678 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:03.369428 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:03.369871 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:03.370571 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:03.371233 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:03.371659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:03.525257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:03.533194 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3219a5e6-fa8f-41d8-961b-e5a4578156fb tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.175759 Sep 09 20:36:03.533796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 406/802] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:03 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:04.557756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:04.558456 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:04.565184 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:04.565701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:04.566141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:04.566831 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:04.567288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:04.567712 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:04.695389 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:04.703008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c7ec1a6a-8117-4eed-b329-0f17b4a790a8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.150130 Sep 09 20:36:04.703569 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 397/803] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:04 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:05.725289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:05.725909 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:05.733060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:05.733582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:05.734015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:05.734987 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:05.735441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:05.735864 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:05.870989 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:05.878793 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b7de4307-9304-4ea9-96d4-e9fa7cd51bd3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.157310 Sep 09 20:36:05.879301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 407/804] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:05 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:06.901853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:06.902704 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:06.909005 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:06.909523 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:06.909951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:06.910640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:06.911129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:06.911491 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:07.053397 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:07.061684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c3876fe0-131b-49b9-87ad-c63c97d56d35 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.164164 Sep 09 20:36:07.062246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 398/805] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:06 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:08.084424 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:08.085033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:08.092029 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:08.092508 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:08.092945 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:08.093660 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:08.094115 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:08.094537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:08.223590 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:08.231713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-61964b83-eac8-43d1-ab49-227dd99bcd8f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.151147 Sep 09 20:36:08.232271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 408/806] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:08 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:09.254944 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:09.255573 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:09.262597 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:09.263071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:09.263500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:09.264206 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:09.264651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:09.265068 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:09.392877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:09.400599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bfe289d3-db05-45ad-9c94-4882bade8a90 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.149561 Sep 09 20:36:09.401160 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 399/807] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:09 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:10.422585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:10.423211 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:10.425559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:10.431694 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:10.432166 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:10.432592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:10.433319 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:10.433769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:10.434182 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:10.563422 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:10.570992 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9bbf27d5-7c13-4092-8fff-69f82ee5729c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.152295 Sep 09 20:36:10.571576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 409/808] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:10 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:11.594457 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:11.595296 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:11.597510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:11.598294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:11.606101 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:11.606595 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:11.607023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:11.607716 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:11.608158 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:11.608572 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:11.779136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:11.787324 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bf5bda8e-62c2-4a28-a94d-63ced7518d56 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.196772 Sep 09 20:36:11.787905 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 400/809] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:11 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:12.810803 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:12.811583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:12.819813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:12.820418 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:12.820957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:12.822336 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:12.823026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:12.823690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:12.891466 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-7d1ddb7b-3f0c-4cb4-a1b2-dc430e0439fd req-2d8c7abe-bcb2-4d8a-8f36-46a959ccd4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc57f22-97e2-44fc-88b3-f5d9f124636e", "name": "network-vif-plugged", "status": "completed", "tag": "581d55fb-fee5-444b-bc2c-64e00c4532de"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:12.900983 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d1ddb7b-3f0c-4cb4-a1b2-dc430e0439fd req-2d8c7abe-bcb2-4d8a-8f36-46a959ccd4b4 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:12.901687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d1ddb7b-3f0c-4cb4-a1b2-dc430e0439fd req-2d8c7abe-bcb2-4d8a-8f36-46a959ccd4b4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:12.902271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-7d1ddb7b-3f0c-4cb4-a1b2-dc430e0439fd req-2d8c7abe-bcb2-4d8a-8f36-46a959ccd4b4 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:12.916220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-7d1ddb7b-3f0c-4cb4-a1b2-dc430e0439fd req-2d8c7abe-bcb2-4d8a-8f36-46a959ccd4b4 service nova] Creating event network-vif-plugged:581d55fb-fee5-444b-bc2c-64e00c4532de for instance ccc57f22-97e2-44fc-88b3-f5d9f124636e on hv-cinder-84932 Sep 09 20:36:12.921699 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-7d1ddb7b-3f0c-4cb4-a1b2-dc430e0439fd req-2d8c7abe-bcb2-4d8a-8f36-46a959ccd4b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044297 Sep 09 20:36:12.922532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 401/810] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:12.988693 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:12.997836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e3ad5a87-dc82-449c-9a30-bcbca3dcaf66 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.191512 Sep 09 20:36:12.998416 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 410/811] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:12 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:14.021532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:14.022839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:14.029521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:14.030000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:14.030669 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:14.031535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:14.032154 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:14.032750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:14.204528 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:14.213781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-96f0bdd2-a1c6-402e-a574-adcc0b815324 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1267 microversion: 2.1 time: 0.196678 Sep 09 20:36:14.214492 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 402/812] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:14 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:15.237811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:15.238560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:15.247239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:15.247884 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:15.248653 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:15.250196 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:15.250764 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:15.251524 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:15.474917 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:15.484457 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b09dce3-0c74-4db9-9c36-89b38de256e8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1454 microversion: 2.1 time: 0.250429 Sep 09 20:36:15.485747 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 411/813] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:15 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1454 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:15.507753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:15.508374 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:15.515692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:15.516603 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:15.517046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:15.517773 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:15.518391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:15.518981 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:15.756198 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:15.765391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a44bd21a-ed97-4b27-8742-2f9aa3b5e5d5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1454 microversion: 2.1 time: 0.261272 Sep 09 20:36:15.766324 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 403/814] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:15 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1454 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:17.807420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-c0551587-f366-433e-b36a-fb6894f45498 req-779ad04b-98a6-4a77-afcb-fb7437d9c783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc57f22-97e2-44fc-88b3-f5d9f124636e", "tag": "581d55fb-fee5-444b-bc2c-64e00c4532de"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:17.827057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c0551587-f366-433e-b36a-fb6894f45498 req-779ad04b-98a6-4a77-afcb-fb7437d9c783 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:17.827916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c0551587-f366-433e-b36a-fb6894f45498 req-779ad04b-98a6-4a77-afcb-fb7437d9c783 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:17.828585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-c0551587-f366-433e-b36a-fb6894f45498 req-779ad04b-98a6-4a77-afcb-fb7437d9c783 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:17.842026 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-c0551587-f366-433e-b36a-fb6894f45498 req-779ad04b-98a6-4a77-afcb-fb7437d9c783 service nova] Creating event network-changed:581d55fb-fee5-444b-bc2c-64e00c4532de for instance ccc57f22-97e2-44fc-88b3-f5d9f124636e on hv-cinder-84932 Sep 09 20:36:17.848279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-c0551587-f366-433e-b36a-fb6894f45498 req-779ad04b-98a6-4a77-afcb-fb7437d9c783 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045172 Sep 09 20:36:17.849664 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 412/815] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:22.375847 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2e19b029-7208-4a28-b511-b0111c630a41 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Action: 'create', calling method: .version_select at 0x7f4834997ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1917405346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAasnrWd8O9RxmF+WGmrhT2lEyYcKAPyHHh3YR138ZDEvYPNoFY5dYa8wmRCXjAJykYifOqsRdtaiEfIq2EI+mUEeg7pLxHdGh1xdAufLVFrf05xvWfqqeNo5OXbzTp5Ww=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:22.392931 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-2e19b029-7208-4a28-b511-b0111c630a41 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Getting quotas for project 474aa97f67a8457ab6900081711a0bf1. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:36:22.396783 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-2e19b029-7208-4a28-b511-b0111c630a41 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Getting quotas for user 3540adbd8efb4a7a97ca44a6c0e5e51d and project 474aa97f67a8457ab6900081711a0bf1. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:36:22.418958 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2e19b029-7208-4a28-b511-b0111c630a41 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.245677 Sep 09 20:36:22.419690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 404/816] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:36:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:36:25.920429 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:25.920960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:25.926999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:25.927476 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:25.927906 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:25.928586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:25.929033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:25.929471 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:25.953126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1741fbf4-3b43-491a-a0c4-93bf374d7e9a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/ips" status: 200 len: 150 microversion: 2.1 time: 0.037664 Sep 09 20:36:25.953724 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 413/817] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:36:25 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:27.348822 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=48 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:27.353725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf9d1d71-4b19-4c8c-87e0-d4147b27e54e"}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:27.356015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:27.363363 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:27.363851 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:27.364300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:27.364990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:27.365480 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:27.365910 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:27.618030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-246673ee-bed4-42ed-84ed-00a290728bce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270321 Sep 09 20:36:27.621279 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 405/818] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:36:27 2022] POST /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:34.124956 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf9d1d71-4b19-4c8c-87e0-d4147b27e54e"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:34.127318 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:34.129843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=23 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:34.135301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:34.135783 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:34.136224 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:34.136941 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:34.137434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:34.137862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:34.141467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=49 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:34.224342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Invalid volume: volume cf9d1d71-4b19-4c8c-87e0-d4147b27e54e is already attached to instances: c79c57c8-9531-4ddb-9c45-ab13ce2198fc Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: POST /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments HTTP/1.1 Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 74 Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:36:34.226216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {"volumeAttachment": {"volumeId": "cf9d1d71-4b19-4c8c-87e0-d4147b27e54e"}} Sep 09 20:36:34.227955 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Invalid volume: volume cf9d1d71-4b19-4c8c-87e0-d4147b27e54e is already attached to instances: c79c57c8-9531-4ddb-9c45-ab13ce2198fc Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'server_id': 'c79c57c8-9531-4ddb-9c45-ab13ce2198fc', 'body': {'volumeAttachment': {'volumeId': 'cf9d1d71-4b19-4c8c-87e0-d4147b27e54e'}}} Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf9d1d71-4b19-4c8c-87e0-d4147b27e54e is already attached to instances: c79c57c8-9531-4ddb-9c45-ab13ce2198fc Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:34.228794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf9d1d71-4b19-4c8c-87e0-d4147b27e54e is already attached to instances: c79c57c8-9531-4ddb-9c45-ab13ce2198fc Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:36:34.230093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf9d1d71-4b19-4c8c-87e0-d4147b27e54e is already attached to instances: c79c57c8-9531-4ddb-9c45-ab13ce2198fc Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 400 to user: Invalid volume: volume cf9d1d71-4b19-4c8c-87e0-d4147b27e54e is already attached to instances: c79c57c8-9531-4ddb-9c45-ab13ce2198fc {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e512072-bea5-470a-95b2-b2c2d8ffb6e3 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106713 Sep 09 20:36:34.231396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 414/819] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:36:34 2022] POST /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 20:36:34.290929 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:34.295434 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:34.296017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:34.297822 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:34.303924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:34.304418 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:34.305374 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:34.306066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:34.306515 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:34.306933 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:34.389829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lazy-loading 'services' on Instance uuid c79c57c8-9531-4ddb-9c45-ab13ce2198fc {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:36:34.461721 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9df6e2e3-a06a-4635-a215-24c9c41c9411 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments/cf9d1d71-4b19-4c8c-87e0-d4147b27e54e" status: 202 len: 0 microversion: 2.1 time: 0.171979 Sep 09 20:36:34.462308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 406/820] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:36:34 2022] DELETE /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments/cf9d1d71-4b19-4c8c-87e0-d4147b27e54e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:36:34.471656 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:34.473978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:34.481366 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:34.481875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:34.483126 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:34.483841 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:34.484813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:34.485216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:34.529369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0cedc54b-0d6d-42d0-acb1-8a7571c97ade tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058990 Sep 09 20:36:34.529951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 415/821] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:36:34 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:35.542147 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:35.544391 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:35.550494 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:35.550970 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:35.551399 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:35.552080 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:35.552531 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:35.552950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:35.584297 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b0cf3d8-ce25-42a6-9a28-61c55eee147e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046926 Sep 09 20:36:35.584845 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 407/822] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:36:35 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:36:35.649859 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:35.650393 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:35.656696 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:35.657172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:35.657637 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:35.658331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:35.658786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:35.659208 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:35.684516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:36:35.760847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2a5ba387-153c-466f-93b4-2d70be97b250 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 204 len: 0 microversion: 2.1 time: 0.114467 Sep 09 20:36:35.761551 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 416/823] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:36:35 2022] DELETE /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:36:35.769876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:35.770524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:35.776513 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:35.776928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:35.777427 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:35.778090 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:35.778532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:35.778944 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:35.909942 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:35.918202 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-127af94a-4511-4546-90c1-1fecc1803e81 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1679 microversion: 2.1 time: 0.152182 Sep 09 20:36:35.918770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 408/824] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:35 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:36.941925 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:36.942554 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:36.948996 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:36.949515 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:36.949949 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:36.950635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:36.951089 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:36.951511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:37.077657 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:37.085219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8e92f58e-0933-4d4d-9f24-d97fa2db79a7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1679 microversion: 2.1 time: 0.147729 Sep 09 20:36:37.086313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 417/825] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:36 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:38.107971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:38.108573 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:38.115261 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:38.115750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:38.116218 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:38.116910 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:38.117392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:38.117814 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:38.254367 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:38.263238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6778ae7b-fc28-4ae9-90d1-3772d7f9f9e1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 200 len: 1679 microversion: 2.1 time: 0.159158 Sep 09 20:36:38.263867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 409/826] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:38 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:38.553422 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-cf3f60c7-b6e7-4baa-a68a-ae396b683b0c req-2ee763f2-7f36-4f3d-8791-c6dedfdf571c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79c57c8-9531-4ddb-9c45-ab13ce2198fc", "name": "network-vif-deleted", "tag": "ddf6e429-ad62-4521-b729-5b52421bc743"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:38.564124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cf3f60c7-b6e7-4baa-a68a-ae396b683b0c req-2ee763f2-7f36-4f3d-8791-c6dedfdf571c service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:38.564593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cf3f60c7-b6e7-4baa-a68a-ae396b683b0c req-2ee763f2-7f36-4f3d-8791-c6dedfdf571c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:38.565031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-cf3f60c7-b6e7-4baa-a68a-ae396b683b0c req-2ee763f2-7f36-4f3d-8791-c6dedfdf571c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:38.577198 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-cf3f60c7-b6e7-4baa-a68a-ae396b683b0c req-2ee763f2-7f36-4f3d-8791-c6dedfdf571c service nova] Creating event network-vif-deleted:ddf6e429-ad62-4521-b729-5b52421bc743 for instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc on hv-cinder-84932 Sep 09 20:36:38.582200 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-cf3f60c7-b6e7-4baa-a68a-ae396b683b0c req-2ee763f2-7f36-4f3d-8791-c6dedfdf571c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032735 Sep 09 20:36:38.582893 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 418/827] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:36:38.751645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-511963853", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1917405346", "security_groups": [{"name": "tempest-secgroup-smoke-117319484"}], "networks": [{"uuid": "b9fd7ce9-9a26-4460-a7fe-f0bc8e7cd808"}], "block_device_mapping_v2": [{"uuid": "b1d6c527-25b4-4e14-bb8b-37e1df584684", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:38.877597 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] validate_networks() for [('b9fd7ce9-9a26-4460-a7fe-f0bc8e7cd808', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:36:39.257597 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:36:39.258657 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:36:39.259654 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:36:39.260173 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:36:39.260770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:36:39.279623 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:39.280297 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:39.280840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:39.281835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:39.283296 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:39.284439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:39.289741 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:39.290635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:39.296899 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:39.297435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:39.298110 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:39.302919 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:39.303365 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Getting quotas for project 474aa97f67a8457ab6900081711a0bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:36:39.303507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:39.303811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:39.307642 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Getting quotas for user 3540adbd8efb4a7a97ca44a6c0e5e51d and project 474aa97f67a8457ab6900081711a0bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:36:39.318773 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc HTTP/1.1 Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:36:39.320560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:36:39.322219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': 'c79c57c8-9531-4ddb-9c45-ab13ce2198fc'} Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:36:39.323155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:36:39.324627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:36:39.326234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:36:39.326234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2e097785-f65f-44f3-bb3c-955a8a1ceddd tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 404 len: 111 microversion: 2.1 time: 0.038671 Sep 09 20:36:39.328807 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 419/828] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:39 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:36:39.337872 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2ad2427c-3aa8-4702-8949-2277624d42f6 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '.version_select at 0x7f48348ada60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:39.360590 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2ad2427c-3aa8-4702-8949-2277624d42f6 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763175717" status: 202 len: 0 microversion: 2.1 time: 0.030610 Sep 09 20:36:39.361166 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 420/829] 10.222.0.26 () {58 vars in 1218 bytes} [Fri Sep 9 20:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763175717 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:36:39.369095 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:36:39.371253 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1d6c527-25b4-4e14-bb8b-37e1df584684',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:36:39.548395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-02fabfd5-cb1e-4dc5-9b53-fbb71f66437b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.800693 Sep 09 20:36:39.553401 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 410/830] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:36:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:36:39.565443 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9685356-8198-41e8-a897-66c4b9f2fc5e tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:39.566057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9685356-8198-41e8-a897-66c4b9f2fc5e tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:39.657486 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9685356-8198-41e8-a897-66c4b9f2fc5e tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:39.665796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9685356-8198-41e8-a897-66c4b9f2fc5e tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1088 microversion: 2.1 time: 0.104858 Sep 09 20:36:39.666680 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 421/831] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:39 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1088 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:40.059612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-04149fda-2ee7-4510-8185-8740e6cc05b5 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: .version_select at 0x7f48349fc0d0>, body: {"keypair": {"name": "tempest-keypair-2139705363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAfuS2nl4dPC/wyL3+tR+HlJqJ2OO6uz7GwQhHoVfswFsByzD78JsJCSqcxE1x/4sIGajBJJcY0CNP37iMpNC8cI5CN2R1OaqY/TNh8Bc6vvykfccQ8kxaTLXP3CLREsg=="}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:40.075845 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-04149fda-2ee7-4510-8185-8740e6cc05b5 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:36:40.079790 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-04149fda-2ee7-4510-8185-8740e6cc05b5 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'key_pairs'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:36:40.102383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-04149fda-2ee7-4510-8185-8740e6cc05b5 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046943 Sep 09 20:36:40.102992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 411/832] 10.222.0.26 () {60 vars in 1159 bytes} [Fri Sep 9 20:36:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:36:40.688003 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:40.688667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:40.695157 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:40.695635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:40.696066 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:40.696759 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:40.697201 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:40.697646 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:40.789442 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:40.799544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f731b5fb-719b-46f6-bb34-1e013ad2d4ea tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1194 microversion: 2.1 time: 0.115430 Sep 09 20:36:40.800192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 422/833] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:40 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:41.542872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1262925296", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acf3cd1a-b4b0-4a34-82b2-e2951d096a8f"}], "security_groups": [{"name": "tempest-securitygroup--1925550633"}], "key_name": "tempest-keypair-2139705363", "user_data": "}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:41.662024 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] validate_networks() for [('acf3cd1a-b4b0-4a34-82b2-e2951d096a8f', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:36:41.824842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:41.825470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:41.832415 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:41.833150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:41.834237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:41.835124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:41.835851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:41.836435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:42.102999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:42.111123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-dd17387d-1478-45cc-85fa-2979c07c6b42 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.290198 Sep 09 20:36:42.113447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 423/834] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:41 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:42.147032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:36:42.147455 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:36:42.148008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:36:42.148415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:36:42.148821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:36:42.157452 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:42.157934 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:42.158363 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:42.159088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:42.159539 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:42.159968 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:42.177186 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:36:42.181373 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Getting quotas for user f0eca860c013457ea79e4633f3e6d895 and project 624ed22fc46047e1a842200db3388b63. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:36:42.192567 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:36:42.195283 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:36:42.243359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d05fc531-44d8-4e84-9fd8-d1f243290e01 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.705140 Sep 09 20:36:42.244250 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 412/835] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:36:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:36:42.255041 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-749e28b1-c20a-4177-8fc3-1fdf0eb75545 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:42.255646 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-749e28b1-c20a-4177-8fc3-1fdf0eb75545 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:42.308962 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-749e28b1-c20a-4177-8fc3-1fdf0eb75545 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:42.316473 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-749e28b1-c20a-4177-8fc3-1fdf0eb75545 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1242 microversion: 2.1 time: 0.065238 Sep 09 20:36:42.317045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 424/836] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:42 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:42.442233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ec64339c-4871-4fc7-9a08-7a60b3b680e4 req-70f41161-0986-4c2a-afb3-de98e2da4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b69aea-f2d0-4dec-abe2-3bfa9af1328f", "tag": "bf962b29-7eb7-46b4-a569-cb818262af3e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:42.487885 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ec64339c-4871-4fc7-9a08-7a60b3b680e4 req-70f41161-0986-4c2a-afb3-de98e2da4f6b service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:42.488680 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ec64339c-4871-4fc7-9a08-7a60b3b680e4 req-70f41161-0986-4c2a-afb3-de98e2da4f6b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:42.489274 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ec64339c-4871-4fc7-9a08-7a60b3b680e4 req-70f41161-0986-4c2a-afb3-de98e2da4f6b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:42.502230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ec64339c-4871-4fc7-9a08-7a60b3b680e4 req-70f41161-0986-4c2a-afb3-de98e2da4f6b service nova] Creating event network-changed:bf962b29-7eb7-46b4-a569-cb818262af3e for instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f on hv-cinder-84932 Sep 09 20:36:42.517738 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ec64339c-4871-4fc7-9a08-7a60b3b680e4 req-70f41161-0986-4c2a-afb3-de98e2da4f6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072048 Sep 09 20:36:42.518522 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 413/837] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:43.136059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:43.136622 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:43.143886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:43.144491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:43.145059 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:43.145781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:43.146226 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:43.146815 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:43.281979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:43.290263 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40cde5f7-59c9-4b98-9956-e431b6b60297 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.158952 Sep 09 20:36:43.290819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 425/838] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:43 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:43.339665 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:43.340357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:43.346837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:43.347310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:43.347737 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:43.348411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:43.348856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:43.349293 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:43.412867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:43.420695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0989dda8-3c2a-4e56-bb0b-1bca979f805e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1294 microversion: 2.1 time: 0.085721 Sep 09 20:36:43.421312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 414/839] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:43 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:44.312274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:44.313040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:44.319457 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:44.320445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:44.320888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:44.321847 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:44.322387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:44.322913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:44.445441 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:44.446864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:44.454590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:44.455555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:44.456243 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:44.457551 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:44.459337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:44.459947 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:44.469762 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:44.480084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a52c9976-d124-4ce2-a1d2-291fd5bb83eb tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.171593 Sep 09 20:36:44.480770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 426/840] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:44 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:44.605585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:44.613465 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3285250-aa7f-4091-9122-b8c3d82c60c1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.173615 Sep 09 20:36:44.614040 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 415/841] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:44 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:45.114739 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-927fd099-3793-475e-8975-6dbb37f39fa9 req-45c8c541-95c7-4a0a-87de-9b0419a4f51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4caaf06d-76d1-4b04-9a95-6de228054337", "tag": "7746db9b-20e7-4d13-93ef-049fa47f14c9"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:45.124647 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-927fd099-3793-475e-8975-6dbb37f39fa9 req-45c8c541-95c7-4a0a-87de-9b0419a4f51c service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:45.125129 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-927fd099-3793-475e-8975-6dbb37f39fa9 req-45c8c541-95c7-4a0a-87de-9b0419a4f51c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:45.125706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-927fd099-3793-475e-8975-6dbb37f39fa9 req-45c8c541-95c7-4a0a-87de-9b0419a4f51c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:45.138220 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-927fd099-3793-475e-8975-6dbb37f39fa9 req-45c8c541-95c7-4a0a-87de-9b0419a4f51c service nova] Creating event network-changed:7746db9b-20e7-4d13-93ef-049fa47f14c9 for instance 4caaf06d-76d1-4b04-9a95-6de228054337 on hv-cinder-84932 Sep 09 20:36:45.143028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-927fd099-3793-475e-8975-6dbb37f39fa9 req-45c8c541-95c7-4a0a-87de-9b0419a4f51c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031974 Sep 09 20:36:45.143627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 427/842] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:45.504337 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:45.505008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:45.512011 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:45.512494 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:45.512934 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:45.513651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:45.514107 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:45.514531 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:45.639120 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:45.640299 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:45.646455 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:45.646938 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:45.647390 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:45.648710 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:45.649165 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:45.649618 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:45.651168 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:45.659026 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-061ccc54-4681-4ea5-a11d-1db503cfbe5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.158522 Sep 09 20:36:45.659904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 416/843] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:45 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:45.776920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:45.784565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3232c59f-31c4-47f3-9871-42f7ad231f37 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.151187 Sep 09 20:36:45.785124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 428/844] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:45 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:46.681735 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:46.682346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:46.688826 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:46.689346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:46.689789 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:46.690484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:46.690935 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:46.691363 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:46.807142 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:46.808286 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:46.814451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:46.814936 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:46.815368 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:46.816089 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:46.816542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:46.816964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:46.824801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:46.832534 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c03ee88f-5d06-4782-9de4-d72003d19a87 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.155321 Sep 09 20:36:46.833115 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 417/845] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:46 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:46.948730 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:46.956299 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aab77431-748e-4a5a-87d7-d6c89d306430 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.153157 Sep 09 20:36:46.956851 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 429/846] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:46 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:47.856148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:47.856744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:47.863318 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:47.863787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:47.864213 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:47.864884 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:47.865356 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:47.865777 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:47.979662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:47.980274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:47.986858 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:47.987341 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:47.987828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:47.988518 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:47.988969 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:47.989426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:47.992924 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:48.000574 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-bdf8ed96-8140-46f6-82eb-f75bbb7b446a tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.148315 Sep 09 20:36:48.001139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 418/847] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:47 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:48.383372 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:48.390898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aac5ea9c-f79e-4729-ba36-2a0cd844e7ce tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.415710 Sep 09 20:36:48.391465 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 430/848] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:47 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:49.023813 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:49.024501 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:49.030848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:49.031327 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:49.031755 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:49.032434 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:49.032881 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:49.033317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:49.161317 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:49.170505 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c24a9c0c-0294-487e-bd54-b06426ca0967 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.150969 Sep 09 20:36:49.171545 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 419/849] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:49 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:49.413569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:49.414182 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:49.420746 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:49.421229 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:49.421691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:49.422381 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:49.422830 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:49.423250 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:49.565014 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:49.573045 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-62ae791d-6799-4aec-ad2a-1972b37d63b1 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.163476 Sep 09 20:36:49.573634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 431/850] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:49 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:50.193610 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:50.194148 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:50.200743 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:50.201223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:50.201678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:50.202355 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:50.202801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:50.203218 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:50.331540 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:50.339104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e443bce2-8672-41c5-b89e-c8a0d54c4f0b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.149550 Sep 09 20:36:50.339660 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 420/851] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:50 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:50.596174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:50.596784 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:50.603761 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:50.604239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:50.604676 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:50.605386 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:50.605837 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:50.606258 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:50.736119 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:50.743708 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6ea8bdfc-730e-4ba0-949b-8b5288c59653 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.151420 Sep 09 20:36:50.744270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 432/852] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:50 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:51.229860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-30a76f11-80f2-4de0-95d1-20e865aa5ab6 req-b68e5cfa-5679-4db4-a57c-b93352c8f602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4caaf06d-76d1-4b04-9a95-6de228054337", "name": "network-vif-plugged", "status": "completed", "tag": "7746db9b-20e7-4d13-93ef-049fa47f14c9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:51.240150 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30a76f11-80f2-4de0-95d1-20e865aa5ab6 req-b68e5cfa-5679-4db4-a57c-b93352c8f602 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:51.240919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30a76f11-80f2-4de0-95d1-20e865aa5ab6 req-b68e5cfa-5679-4db4-a57c-b93352c8f602 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:51.242090 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-30a76f11-80f2-4de0-95d1-20e865aa5ab6 req-b68e5cfa-5679-4db4-a57c-b93352c8f602 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:51.255728 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-30a76f11-80f2-4de0-95d1-20e865aa5ab6 req-b68e5cfa-5679-4db4-a57c-b93352c8f602 service nova] Creating event network-vif-plugged:7746db9b-20e7-4d13-93ef-049fa47f14c9 for instance 4caaf06d-76d1-4b04-9a95-6de228054337 on hv-cinder-84932 Sep 09 20:36:51.261134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-30a76f11-80f2-4de0-95d1-20e865aa5ab6 req-b68e5cfa-5679-4db4-a57c-b93352c8f602 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034888 Sep 09 20:36:51.261766 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 421/853] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:51.362389 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:51.362997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:51.369508 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:51.369989 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:51.370419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:51.371109 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:51.371558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:51.371981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:51.511387 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:51.519324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-11ef3241-fdbe-4a2e-a2b5-0c4ff9941415 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.161043 Sep 09 20:36:51.519895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 433/854] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:51 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:51.766920 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:51.767722 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:51.774517 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:51.775000 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:51.775437 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:51.776127 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:51.776577 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:51.776998 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:51.905153 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:51.912766 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ac4dd67a-b0ad-432c-bd77-f67ed8791806 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.150168 Sep 09 20:36:51.913352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 422/855] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:51 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:52.546995 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:52.547598 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:52.550033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=4 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:52.555130 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:52.555610 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:52.556044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:52.556730 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:52.557180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:52.557627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:52.561879 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:52.691667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:52.699956 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-534a9bf3-923f-4531-a321-6afddee5a714 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.156847 Sep 09 20:36:52.700518 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 434/856] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:52 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:52.935876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:52.936426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:52.938374 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=4 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:52.939151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=16 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:52.946584 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:52.947063 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:52.947487 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:52.948178 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:52.948625 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:52.949038 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:52.953362 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:36:53.088844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:53.096400 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dde65cf9-0996-4884-b8f5-eb41c946f527 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1368 microversion: 2.1 time: 0.164535 Sep 09 20:36:53.096959 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 423/857] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:52 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:53.284942 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-4d487eab-7807-4788-a882-4b7bc10eb318 req-2c234eed-158f-4f63-88a2-4bc2f744f389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b69aea-f2d0-4dec-abe2-3bfa9af1328f", "name": "network-vif-plugged", "status": "completed", "tag": "bf962b29-7eb7-46b4-a569-cb818262af3e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:53.295414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d487eab-7807-4788-a882-4b7bc10eb318 req-2c234eed-158f-4f63-88a2-4bc2f744f389 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:53.295880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d487eab-7807-4788-a882-4b7bc10eb318 req-2c234eed-158f-4f63-88a2-4bc2f744f389 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:53.296302 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-4d487eab-7807-4788-a882-4b7bc10eb318 req-2c234eed-158f-4f63-88a2-4bc2f744f389 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:53.307741 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-4d487eab-7807-4788-a882-4b7bc10eb318 req-2c234eed-158f-4f63-88a2-4bc2f744f389 service nova] Creating event network-vif-plugged:bf962b29-7eb7-46b4-a569-cb818262af3e for instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f on hv-cinder-84932 Sep 09 20:36:53.312412 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-4d487eab-7807-4788-a882-4b7bc10eb318 req-2c234eed-158f-4f63-88a2-4bc2f744f389 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031274 Sep 09 20:36:53.312978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 435/858] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:53.722932 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:53.723535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:53.729414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:53.729891 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:53.730321 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:53.731024 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:53.731472 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:53.731890 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:53.864124 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:53.871718 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff4631cb-d22a-4368-bf31-518ee8632435 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.152644 Sep 09 20:36:53.872280 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 424/859] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:53 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:54.120920 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:54.121575 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:54.127642 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:54.128116 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:54.128546 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:54.129217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:54.129691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:54.130105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:54.256008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:54.264123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e9f3dc5-9ca2-4e95-af04-17f17f33117f tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1558 microversion: 2.1 time: 0.148478 Sep 09 20:36:54.264681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 436/860] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:54 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:54.285880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:54.286359 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:54.293102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:54.293617 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:54.294048 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:54.294734 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:54.295290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:54.295717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:54.372087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81cecaeb-4e28-4588-b433-0a43af0cd48d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090040 Sep 09 20:36:54.372750 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 425/861] 10.222.0.26 () {58 vars in 1275 bytes} [Fri Sep 9 20:36:54 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:54.895361 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:54.895977 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:54.901982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:54.902465 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:54.902894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:54.903584 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:54.904032 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:54.904449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:55.121382 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:55.129220 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ef165951-546a-40fd-84ca-d6f13de31a1b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1259 microversion: 2.1 time: 0.238034 Sep 09 20:36:55.129886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 437/862] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:54 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:55.365237 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-5be3a56a-94bc-4996-8648-916eedec30a6 req-ef50044a-ce78-46c2-b977-3e87ebdef1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4caaf06d-76d1-4b04-9a95-6de228054337", "tag": "7746db9b-20e7-4d13-93ef-049fa47f14c9"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:55.374444 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5be3a56a-94bc-4996-8648-916eedec30a6 req-ef50044a-ce78-46c2-b977-3e87ebdef1ea service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:55.375015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5be3a56a-94bc-4996-8648-916eedec30a6 req-ef50044a-ce78-46c2-b977-3e87ebdef1ea service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:55.375512 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-5be3a56a-94bc-4996-8648-916eedec30a6 req-ef50044a-ce78-46c2-b977-3e87ebdef1ea service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:55.386880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-5be3a56a-94bc-4996-8648-916eedec30a6 req-ef50044a-ce78-46c2-b977-3e87ebdef1ea service nova] Creating event network-changed:7746db9b-20e7-4d13-93ef-049fa47f14c9 for instance 4caaf06d-76d1-4b04-9a95-6de228054337 on hv-cinder-84932 Sep 09 20:36:55.392268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-5be3a56a-94bc-4996-8648-916eedec30a6 req-ef50044a-ce78-46c2-b977-3e87ebdef1ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031060 Sep 09 20:36:55.392929 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 426/863] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:36:56.154517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:56.155363 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:56.162064 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:56.162544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:56.162974 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:56.163669 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:56.164111 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:56.164528 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:56.298708 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:56.306643 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ca178d00-5b0a-4240-9135-4ad8cc6b0dfa tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1443 microversion: 2.1 time: 0.158495 Sep 09 20:36:56.307216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 438/864] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:56 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:36:56.329687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:36:56.330367 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:36:56.337093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:56.337684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:56.338120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:56.338805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:56.339257 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:56.339678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:56.470646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:36:56.478369 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c327ce8-138e-4361-ac81-4b8fea5109be tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1443 microversion: 2.1 time: 0.152972 Sep 09 20:36:56.478927 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 427/865] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:36:56 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:36:58.390063 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-64b8bd15-fb59-46f7-add3-37f423a9696f req-9736403a-6959-4f0a-afd2-ce4dc339cd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b69aea-f2d0-4dec-abe2-3bfa9af1328f", "tag": "bf962b29-7eb7-46b4-a569-cb818262af3e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:36:58.400490 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64b8bd15-fb59-46f7-add3-37f423a9696f req-9736403a-6959-4f0a-afd2-ce4dc339cd6c service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:36:58.401052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64b8bd15-fb59-46f7-add3-37f423a9696f req-9736403a-6959-4f0a-afd2-ce4dc339cd6c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:36:58.401562 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-64b8bd15-fb59-46f7-add3-37f423a9696f req-9736403a-6959-4f0a-afd2-ce4dc339cd6c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:36:58.412295 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-64b8bd15-fb59-46f7-add3-37f423a9696f req-9736403a-6959-4f0a-afd2-ce4dc339cd6c service nova] Creating event network-changed:bf962b29-7eb7-46b4-a569-cb818262af3e for instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f on hv-cinder-84932 Sep 09 20:36:58.417306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-64b8bd15-fb59-46f7-add3-37f423a9696f req-9736403a-6959-4f0a-afd2-ce4dc339cd6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031743 Sep 09 20:36:58.418169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 439/866] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:31.382919 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:31.383478 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:31.385801 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:37:31.386447 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=22 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:37:31.392120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:31.392607 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:31.393039 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:31.393756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:31.394207 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:31.394629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:31.418436 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-370a9d6b-8bf9-4295-afbe-0006a9f28120 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/ips" status: 200 len: 150 microversion: 2.1 time: 0.039956 Sep 09 20:37:31.418930 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 428/867] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:37:31 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:32.745694 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:37:32.746430 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=27 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:37:32.750681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6111363a-f5a1-481c-8819-f7f9633bdd09"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:37:32.753098 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:32.760796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:32.761290 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:32.761722 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:32.762396 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:32.762843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:32.763259 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:32.997736 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-ddf4a8fe-c2a1-4ec7-85a3-3f782ee30bd7 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "POST /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253446 Sep 09 20:37:32.998643 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 440/868] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:37:32 2022] POST /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:40.627355 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:40.627878 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:40.634418 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:40.634894 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:40.635322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:40.635994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:40.636439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:40.636856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:40.716842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lazy-loading 'services' on Instance uuid 4caaf06d-76d1-4b04-9a95-6de228054337 {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:37:40.789685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f3bb9d29-a1cb-4df0-9a34-b1f9973d0037 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments/6111363a-f5a1-481c-8819-f7f9633bdd09" status: 202 len: 0 microversion: 2.1 time: 0.166043 Sep 09 20:37:40.790272 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 429/869] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:37:40 2022] DELETE /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments/6111363a-f5a1-481c-8819-f7f9633bdd09 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:37:40.799577 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:40.802175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:40.808298 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:40.808781 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:40.809221 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:40.809927 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:40.810371 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:40.810786 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:40.841177 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e305dd64-d404-4df6-b747-b5807097de80 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046408 Sep 09 20:37:40.841770 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 441/870] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:37:40 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:41.854277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:41.856532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:41.863521 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:41.864043 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:41.864468 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:41.865143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:41.865616 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:41.866035 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:41.894332 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4a9871b3-eb75-41d1-a3d2-201fd2682a78 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044402 Sep 09 20:37:41.894867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 430/871] 10.222.0.26 () {58 vars in 1302 bytes} [Fri Sep 9 20:37:41 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 20:37:41.956850 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:41.957570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:41.964368 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:41.964844 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:41.965301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:41.965987 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:41.966436 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:41.966854 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:41.992036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:37:42.064343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3db50c6d-15b2-4303-9b42-fd8552a3056d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 204 len: 0 microversion: 2.1 time: 0.111027 Sep 09 20:37:42.065105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 442/872] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:37:41 2022] DELETE /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:37:42.074224 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:42.074886 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:42.081869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:42.082335 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:42.082837 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:42.083615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:42.084070 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:42.084494 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:42.213233 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:37:42.220859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-cfeea511-05c5-47a1-952d-df70a2044d0d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1683 microversion: 2.1 time: 0.151005 Sep 09 20:37:42.221442 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 431/873] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:42 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:37:43.245024 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:43.245752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:43.252155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:43.252654 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:43.253075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:43.253788 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:43.254235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:43.254658 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:43.380006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:37:43.387604 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-43042016-b404-471e-b6f3-eba942b3a85d tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1683 microversion: 2.1 time: 0.146932 Sep 09 20:37:43.388171 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 443/874] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:43 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:37:44.410644 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:44.411352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:44.418334 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:44.418839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:44.419296 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:44.419980 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:44.420421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:44.420855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:44.492840 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0eca860c013457ea79e4633f3e6d895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '624ed22fc46047e1a842200db3388b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:37:44.500612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e00268c2-4227-4413-b705-9ce4cb96b184 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 200 len: 1615 microversion: 2.1 time: 0.093983 Sep 09 20:37:44.501181 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 432/875] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:44 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:37:44.656015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-a5623dfc-04bb-4f85-be32-0387894c2868 req-856abbe4-fb5b-4355-822b-ac7af8e070bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4caaf06d-76d1-4b04-9a95-6de228054337", "name": "network-vif-deleted", "tag": "7746db9b-20e7-4d13-93ef-049fa47f14c9"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:37:44.672960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a5623dfc-04bb-4f85-be32-0387894c2868 req-856abbe4-fb5b-4355-822b-ac7af8e070bc service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:44.673090 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a5623dfc-04bb-4f85-be32-0387894c2868 req-856abbe4-fb5b-4355-822b-ac7af8e070bc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:44.673634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-a5623dfc-04bb-4f85-be32-0387894c2868 req-856abbe4-fb5b-4355-822b-ac7af8e070bc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:44.687343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-a5623dfc-04bb-4f85-be32-0387894c2868 req-856abbe4-fb5b-4355-822b-ac7af8e070bc service nova] Creating event network-vif-deleted:7746db9b-20e7-4d13-93ef-049fa47f14c9 for instance 4caaf06d-76d1-4b04-9a95-6de228054337 on hv-cinder-84932 Sep 09 20:37:44.694559 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-a5623dfc-04bb-4f85-be32-0387894c2868 req-856abbe4-fb5b-4355-822b-ac7af8e070bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041695 Sep 09 20:37:44.695345 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 444/876] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:45.524496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:45.525705 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:45.532108 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:45.532603 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:45.533037 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:45.533764 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:45.534222 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:45.534655 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:45.548719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 HTTP/1.1 Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:37:45.550415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:45.552223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '4caaf06d-76d1-4b04-9a95-6de228054337'} Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:45.553099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:45.554483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:45.555709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:45.555709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-50a8944c-0303-4741-acad-61744c137343 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 404 len: 111 microversion: 2.1 time: 0.031835 Sep 09 20:37:45.555709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 433/877] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:45 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:45.561712 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-60a3d6a0-e5e7-43a9-8166-5e2a4c84d948 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '.version_select at 0x7f4834957940>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:45.581186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-60a3d6a0-e5e7-43a9-8166-5e2a4c84d948 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139705363" status: 202 len: 0 microversion: 2.1 time: 0.023876 Sep 09 20:37:45.581803 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 445/878] 10.222.0.26 () {58 vars in 1221 bytes} [Fri Sep 9 20:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139705363 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:37:47.324591 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:47.325113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:47.331510 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:47.331984 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:47.332421 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:47.333117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:47.333594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:47.334015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:47.347375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 HTTP/1.1 Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:37:47.349435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.351036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '4caaf06d-76d1-4b04-9a95-6de228054337'} Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:47.351880 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.353138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.354433 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:47.354433 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f448a2c4-a3d4-4412-b025-f172842c4664 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 404 len: 111 microversion: 2.1 time: 0.030039 Sep 09 20:37:47.354433 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 434/879] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:37:47 2022] DELETE /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:47.359549 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:47.360272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 4caaf06d-76d1-4b04-9a95-6de228054337] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:47.367875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:47.368342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:47.368795 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:47.369499 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:47.369944 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:47.370358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:47.383258 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 HTTP/1.1 Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:37:47.384862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.386475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '4caaf06d-76d1-4b04-9a95-6de228054337'} Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:47.387555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. Sep 09 20:37:47.389150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:47.390636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 4caaf06d-76d1-4b04-9a95-6de228054337 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:47.390636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6f6ac4a4-e648-4ef9-8be9-fa28bae1bf74 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337" status: 404 len: 111 microversion: 2.1 time: 0.030893 Sep 09 20:37:47.390636 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 446/880] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:47 2022] GET /compute/v2.1/servers/4caaf06d-76d1-4b04-9a95-6de228054337 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:48.538560 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:48.539090 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:48.545497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.545982 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.546417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.547117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.547593 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.548021 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.561308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc HTTP/1.1 Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:37:48.562821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.564490 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'c79c57c8-9531-4ddb-9c45-ab13ce2198fc'} Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:48.565414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.566664 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.568398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:48.568398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c103d3e-e13d-4d0d-87a6-262a72a17d2a tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 404 len: 111 microversion: 2.1 time: 0.030242 Sep 09 20:37:48.568398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 435/881] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:37:48 2022] DELETE /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:48.573233 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:48.573899 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: c79c57c8-9531-4ddb-9c45-ab13ce2198fc] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:48.580179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.580655 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.581088 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.581819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.582271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.583241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.598330 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc HTTP/1.1 Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:37:48.599824 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.601507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': 'c79c57c8-9531-4ddb-9c45-ab13ce2198fc'} Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:48.602468 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. Sep 09 20:37:48.604010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.605435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance c79c57c8-9531-4ddb-9c45-ab13ce2198fc could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:48.605435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-be7cf73a-d851-471c-9f10-135d7be65272 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc" status: 404 len: 111 microversion: 2.1 time: 0.031893 Sep 09 20:37:48.605435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 447/882] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:48 2022] GET /compute/v2.1/servers/c79c57c8-9531-4ddb-9c45-ab13ce2198fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:48.609855 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:48.610383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:48.616285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.616762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.617196 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.617901 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.618352 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.618774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.632613 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 HTTP/1.1 Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:37:48.634144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.635900 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '9dd0fa94-e842-4150-9939-37899a89da44'} Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:48.636823 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.638126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.639417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:48.639417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-8ec00edd-9a18-486c-b9eb-a6462a61e81e tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 404 len: 111 microversion: 2.1 time: 0.029691 Sep 09 20:37:48.639417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 436/883] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:37:48 2022] DELETE /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:48.643984 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:48.644609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 9dd0fa94-e842-4150-9939-37899a89da44] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:48.651058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.651535 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.651969 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.652647 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:48.653099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:48.653541 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:48.666721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 HTTP/1.1 Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:37:48.668235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.669903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '9dd0fa94-e842-4150-9939-37899a89da44'} Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:48.670833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. Sep 09 20:37:48.672681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:48.674151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 9dd0fa94-e842-4150-9939-37899a89da44 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:48.674151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d07f1147-4ecc-4be3-ac1f-f97852e1e9a8 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44" status: 404 len: 111 microversion: 2.1 time: 0.029529 Sep 09 20:37:48.674151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 448/884] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:48 2022] GET /compute/v2.1/servers/9dd0fa94-e842-4150-9939-37899a89da44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:49.814267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:49.814756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:49.821630 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:49.822102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:49.822566 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:49.823231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:49.823678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:49.824094 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:49.837293 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 HTTP/1.1 Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:37:49.838797 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.840426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '85ad8e52-a548-49df-88d4-9969d1bcf873'} Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:49.841277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.842571 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.844278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:49.844278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-88faf584-150a-45ab-acf2-dd43b46ce330 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "DELETE /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 404 len: 111 microversion: 2.1 time: 0.029733 Sep 09 20:37:49.844278 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 437/885] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:37:49 2022] DELETE /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:49.848677 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:49.849297 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] [instance: 85ad8e52-a548-49df-88d4-9969d1bcf873] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:37:49.855631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:49.856103 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:49.856529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:49.857203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:37:49.857673 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:37:49.858351 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:37:49.871913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] HTTP exception thrown: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Request method failure captured: Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 HTTP/1.1 Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6MUm7LUYBd7stvLjVpnRVtlzf2wQUSMrNi79QfyUmo74WefFlNo39oDuC61DV_oztgNtw11v0-R_3KX2bnX52ICQ15MGy-wkBefgiUeDjte4GJtCo0mg5vpVFA-HyB3cSFvRrf8rkHnmXrLPkidnGuVsJEwIyW7uamBMYacI69BRKA Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:37:49.873438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/624ed22fc46047e1a842200db3388b63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/624ed22fc46047e1a842200db3388b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_624ed22fc46047e1a842200db3388b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 624ed22fc46047e1a842200db3388b63 Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-763432452 Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: f0eca860c013457ea79e4633f3e6d895 Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-AttachVolumeNegativeTest-763432452-project Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.875084 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '85ad8e52-a548-49df-88d4-9969d1bcf873'} Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:49.876141 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. Sep 09 20:37:49.877769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:37:49.879970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] Returning 404 to user: Instance 85ad8e52-a548-49df-88d4-9969d1bcf873 could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:49.879970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-29a49111-d3b0-4e48-ab36-8e4c0f4f3c07 tempest-AttachVolumeNegativeTest-763432452 tempest-AttachVolumeNegativeTest-763432452-project] 10.222.0.26 "GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873" status: 404 len: 111 microversion: 2.1 time: 0.029947 Sep 09 20:37:49.879970 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 449/886] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:37:49 2022] GET /compute/v2.1/servers/85ad8e52-a548-49df-88d4-9969d1bcf873 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:37:54.050117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-97f42132-7977-4cd0-8e31-4b20ab8895ee tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Action: 'create', calling method: .version_select at 0x7f4834a0e0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-218143314", "metadata": {"Type": "work"}}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:37:54.334857 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-97f42132-7977-4cd0-8e31-4b20ab8895ee tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.396243 Sep 09 20:37:54.335506 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 438/887] 10.222.0.26 () {60 vars in 1156 bytes} [Fri Sep 9 20:37:53 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 20:37:54.348826 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3ee9d9f1-59f5-4177-a477-fffdab3d8d3e tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Calling method '.version_select at 0x7f4834957b80>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:54.399075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3ee9d9f1-59f5-4177-a477-fffdab3d8d3e tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd" status: 200 len: 352 microversion: 2.1 time: 0.054646 Sep 09 20:37:54.399787 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 450/888] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:37:54 2022] GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:37:55.414104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a73982b1-7e5d-45e0-964e-2c45cca326d9 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Calling method '.version_select at 0x7f48349dedc0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:55.463546 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a73982b1-7e5d-45e0-964e-2c45cca326d9 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd" status: 200 len: 353 microversion: 2.1 time: 0.054295 Sep 09 20:37:55.464105 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 439/889] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:37:55 2022] GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:55.477596 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c6eb2369-ace0-4335-8767-bab5c6b74566 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Calling method '.version_select at 0x7f48349edc10>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:55.523769 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c6eb2369-ace0-4335-8767-bab5c6b74566 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd" status: 200 len: 353 microversion: 2.1 time: 0.050895 Sep 09 20:37:55.524322 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 451/890] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:37:55 2022] GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:55.542639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-5f1faa3f-4146-410b-b22d-b8dde2815fdd tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Calling method '.version_select at 0x7f4834a0e9d0>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:55.600323 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-5f1faa3f-4146-410b-b22d-b8dde2815fdd tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd" status: 202 len: 0 microversion: 2.1 time: 0.061409 Sep 09 20:37:55.600892 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 440/891] 10.222.0.26 () {58 vars in 1248 bytes} [Fri Sep 9 20:37:55 2022] DELETE /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 20:37:55.609393 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74de649b-1419-4700-8b17-0cc9b0afaf16 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Calling method '.version_select at 0x7f48349729d0>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:55.656133 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74de649b-1419-4700-8b17-0cc9b0afaf16 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd" status: 200 len: 352 microversion: 2.1 time: 0.050835 Sep 09 20:37:55.656795 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 452/892] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:37:55 2022] GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:37:56.671514 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b57fcdf-1528-4804-b3c4-54ccd52d6819 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Calling method '.version_select at 0x7f4834a25160>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:37:56.699662 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-6b57fcdf-1528-4804-b3c4-54ccd52d6819 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] HTTP exception thrown: Volume 9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd could not be found. Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b57fcdf-1528-4804-b3c4-54ccd52d6819 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Request method failure captured: Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd HTTP/1.1 Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6QhYRfjlKxRLdoEdhC8BSQbSJLFDWWZ951EEvRXUwiay7_taD9_qC8dlBsOoQaxcKa4u4Aszr3PG3bWlNRsZ_h3lxAcHq6-FCkAQiMDHYVnwtBeA0Eo6R6M8h4Xi-Ya8vHqzRVj1lTY3Oee003x7wcFvL4NDHmLn6yaWy5yuqKCEJY Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 4ff5e199265744139faaa93df17c4292 Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesGetTestJSON-747492665 Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:37:56.701639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ff5e199265744139faaa93df17c4292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ff5e199265744139faaa93df17c4292"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ff5e199265744139faaa93df17c4292"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ff5e199265744139faaa93df17c4292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesGetTestJSON-747492665 Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 4ff5e199265744139faaa93df17c4292 Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesGetTestJSON-747492665 Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesGetTestJSON-747492665-project Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: c754968435064e548f54fbf02616708a Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesGetTestJSON-747492665-project Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Volume 9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd could not be found. Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd'} Sep 09 20:37:56.703310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd could not be found. (HTTP 404) (Request-ID: req-ef40117f-3463-484e-a73e-697c00b63080) Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:56.704344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 20:37:56.705819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd could not be found. Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 20:37:56.707289 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd could not be found. Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd could not be found. Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6b57fcdf-1528-4804-b3c4-54ccd52d6819 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] Returning 404 to user: Volume 9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6b57fcdf-1528-4804-b3c4-54ccd52d6819 tempest-VolumesGetTestJSON-747492665 tempest-VolumesGetTestJSON-747492665-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd" status: 404 len: 109 microversion: 2.1 time: 0.035813 Sep 09 20:37:56.708733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 441/893] 10.222.0.26 () {58 vars in 1245 bytes} [Fri Sep 9 20:37:56 2022] GET /compute/v2.1/os-volumes/9bd973f0-1c0e-44c6-9344-8ff4d92a0bcd => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:38:16.382523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:16.383274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:16.387996 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:16.388480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:16.397358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:16.397832 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:16.398256 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:16.398931 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:16.399378 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:16.399792 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:16.427130 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:38:16.499213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8d2fd06-75a2-4288-834c-224eb833195a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 204 len: 0 microversion: 2.1 time: 0.117986 Sep 09 20:38:16.502916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 453/894] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:38:16 2022] DELETE /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:38:16.506691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=20 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:16.508914 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:16.514599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:16.516135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:16.530405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:16.530912 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:16.531350 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:16.532049 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:16.532497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:16.532918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:16.834765 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:16.842434 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4d80d0d3-98e6-489b-90c3-cc52e3677bac tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1579 microversion: 2.1 time: 0.338352 Sep 09 20:38:16.842992 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 442/895] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:16 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1579 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:38:17.865946 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:17.866587 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:17.872843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:17.873351 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:17.873787 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:17.874472 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:17.874922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:17.875343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:18.055046 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:18.062798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-68b25a31-19e8-4ce6-af24-b06b84ec7b6b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1579 microversion: 2.1 time: 0.201240 Sep 09 20:38:18.063368 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 454/896] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:17 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1579 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:19.068253 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-f160b55f-2208-4a35-9644-24c6cd9fca5c req-14bda928-1384-4516-ae36-8d531088caee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc57f22-97e2-44fc-88b3-f5d9f124636e", "name": "network-vif-deleted", "tag": "581d55fb-fee5-444b-bc2c-64e00c4532de"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:19.084484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f160b55f-2208-4a35-9644-24c6cd9fca5c req-14bda928-1384-4516-ae36-8d531088caee service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:19.085009 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f160b55f-2208-4a35-9644-24c6cd9fca5c req-14bda928-1384-4516-ae36-8d531088caee service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:19.085484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-f160b55f-2208-4a35-9644-24c6cd9fca5c req-14bda928-1384-4516-ae36-8d531088caee service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:19.087062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:19.088230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:19.095884 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:19.096836 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:19.097981 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:19.099484 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:19.100379 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:19.100990 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:19.111847 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-f160b55f-2208-4a35-9644-24c6cd9fca5c req-14bda928-1384-4516-ae36-8d531088caee service nova] Creating event network-vif-deleted:581d55fb-fee5-444b-bc2c-64e00c4532de for instance ccc57f22-97e2-44fc-88b3-f5d9f124636e on hv-cinder-84932 Sep 09 20:38:19.126631 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-f160b55f-2208-4a35-9644-24c6cd9fca5c req-14bda928-1384-4516-ae36-8d531088caee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062344 Sep 09 20:38:19.127114 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 443/897] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:38:19.204629 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:19.222149 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4e38328f-2eb4-4256-9375-bb10791708b8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1226 microversion: 2.1 time: 0.139408 Sep 09 20:38:19.223103 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 455/898] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:19 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:38:20.247736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:20.248425 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:20.254977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:20.255448 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:20.255875 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:20.256553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:20.256999 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:20.257455 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:20.320805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:20.328419 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-20b6aed8-508f-41c8-8817-3b6365ddf245 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1226 microversion: 2.1 time: 0.085318 Sep 09 20:38:20.328972 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 444/899] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:20 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:21.351728 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:21.352331 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:21.358929 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:21.359406 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:21.359833 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:21.360511 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:21.360957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:21.361407 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:21.423239 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:21.430875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a1893321-5971-413e-aadd-87cbc7e8b45d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1226 microversion: 2.1 time: 0.083551 Sep 09 20:38:21.431368 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 456/900] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:21 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:22.453204 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:22.453861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:22.460994 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:22.461635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:22.462077 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:22.462775 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:22.463221 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:22.463653 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:22.526642 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:22.534378 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e2df8a37-6f1f-48f6-b0fd-23b4c6c1e760 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1226 microversion: 2.1 time: 0.085050 Sep 09 20:38:22.534942 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 445/901] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:22 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:23.556937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:23.557586 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:23.563978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:23.564460 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:23.564897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:23.565615 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:23.566072 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:23.566495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:23.626324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:23.634013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-556ea70b-bafc-43a4-bd9a-5e3df54482ea tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1226 microversion: 2.1 time: 0.081013 Sep 09 20:38:23.634576 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 457/902] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:23 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:24.657172 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:24.657813 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:24.664322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:24.664807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:24.665266 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:24.665955 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:24.666415 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:24.666838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:24.727060 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:24.734819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9d2beb17-5478-4143-9075-ddef78874ec1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 200 len: 1226 microversion: 2.1 time: 0.081844 Sep 09 20:38:24.735375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 446/903] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:24 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:25.757531 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:25.758155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:25.765430 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:25.765952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:25.766448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:25.767260 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:25.767717 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:25.768168 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:25.783509 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] HTTP exception thrown: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Request method failure captured: Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e HTTP/1.1 Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6OTvUtVijjpibOBC49igquZl2pvDbCohkxwWGQqNmiuhP45IIb0DzQoTr1pgZePjQKj1R_1-6i5c572v4oUw0vIOJtCAU5aZEJUOjBWC-Yruya2IeTRUlyaiOizDQSyXuuu3kO4tmgKCOHU5q_IuxZJ2oc8znLOJi2n3S9Eipkg6e4 Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:38:25.785237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 63371d392c8c4b73939ee73a1627c8dd Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:38:25.787036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': 'ccc57f22-97e2-44fc-88b3-f5d9f124636e'} Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:38:25.788159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:38:25.789818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:38:25.791376 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Returning 404 to user: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:38:25.791376 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-0f06caeb-ba23-4012-8a7e-9b237923afc8 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 404 len: 111 microversion: 2.1 time: 0.033476 Sep 09 20:38:25.791376 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 458/904] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:25 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:38:25.885157 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-380104141", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1370114658", "security_groups": [{"name": "tempest-secgroup-smoke-1813791276"}], "block_device_mapping_v2": [{"uuid": "595fef32-9d38-43ab-bea5-0a71a6eeab99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59e2f46b-26f1-41b6-a478-bcc0b9346326"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:26.004977 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] validate_networks() for [('59e2f46b-26f1-41b6-a478-bcc0b9346326', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:38:26.383725 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:38:26.384142 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:38:26.384607 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:38:26.385030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:38:26.385529 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:38:26.394199 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:26.394671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:26.395098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:26.395807 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:26.396252 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:26.396666 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:26.413556 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:38:26.417512 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for user 63371d392c8c4b73939ee73a1627c8dd and project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:38:26.474628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:38:26.476784 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='595fef32-9d38-43ab-bea5-0a71a6eeab99',volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:38:26.602319 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-ff83c09a-bf5b-44cd-b537-c2393739d5ab tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721599 Sep 09 20:38:26.603102 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 447/905] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:38:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:38:26.614214 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c516462f-38f3-4241-bcba-dcafa2264dc5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:26.614822 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c516462f-38f3-4241-bcba-dcafa2264dc5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:26.668612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c516462f-38f3-4241-bcba-dcafa2264dc5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:26.675738 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c516462f-38f3-4241-bcba-dcafa2264dc5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1094 microversion: 2.1 time: 0.065345 Sep 09 20:38:26.676321 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 459/906] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:26 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:27.699325 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:27.700129 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:27.709856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:27.710346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:27.710780 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:27.711493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:27.711947 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:27.712368 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:27.794404 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:27.803267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6c34596f-082f-4f39-80e7-1f9240dad8e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1192 microversion: 2.1 time: 0.108495 Sep 09 20:38:27.804436 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 448/907] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:27 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:28.827880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:28.828463 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:28.835519 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:28.836006 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:28.836433 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:28.837164 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:28.837638 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:28.838057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:28.974916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:28.983202 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9aee8468-95ad-4fec-97e5-bf6532f36aa7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.159213 Sep 09 20:38:28.984212 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 460/908] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:28 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:29.246449 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cacbf585-e552-45e0-b9af-d6c1270643a8 req-a8ed2d6b-f4cc-4318-8995-09f90ea2d9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea398be-0e07-4d50-86af-c37c921b8aca", "tag": "e4ac1fe9-a628-4015-bbd3-20c817809bdd"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:29.257956 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cacbf585-e552-45e0-b9af-d6c1270643a8 req-a8ed2d6b-f4cc-4318-8995-09f90ea2d9d3 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:29.258685 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cacbf585-e552-45e0-b9af-d6c1270643a8 req-a8ed2d6b-f4cc-4318-8995-09f90ea2d9d3 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:29.259125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cacbf585-e552-45e0-b9af-d6c1270643a8 req-a8ed2d6b-f4cc-4318-8995-09f90ea2d9d3 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:29.272620 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cacbf585-e552-45e0-b9af-d6c1270643a8 req-a8ed2d6b-f4cc-4318-8995-09f90ea2d9d3 service nova] Creating event network-changed:e4ac1fe9-a628-4015-bbd3-20c817809bdd for instance 4ea398be-0e07-4d50-86af-c37c921b8aca on hv-cinder-84932 Sep 09 20:38:29.278120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cacbf585-e552-45e0-b9af-d6c1270643a8 req-a8ed2d6b-f4cc-4318-8995-09f90ea2d9d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036072 Sep 09 20:38:29.279121 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 449/909] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:38:30.007435 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:30.008179 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:30.015072 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:30.015583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:30.016018 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:30.016721 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:30.017236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:30.017685 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:30.149759 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:30.157790 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9d533f21-729b-40b7-b91a-28f81b81ec32 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.154801 Sep 09 20:38:30.158475 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 461/910] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:30 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:31.182226 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:31.182847 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:31.190032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:31.190511 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:31.190945 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:31.192257 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:31.192751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:31.193176 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:31.321137 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:31.328711 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-264abcd1-6dbf-4c13-8aa6-c63fa8141e93 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.150842 Sep 09 20:38:31.329291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 450/911] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:31 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:32.351552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:32.352123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:32.358599 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:32.359339 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:32.359778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:32.360472 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:32.360926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:32.361377 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:32.504199 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:32.511895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-6223ee52-f835-40c2-9a20-37062d5d8041 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.164861 Sep 09 20:38:32.512457 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 462/912] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:32 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:33.534001 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:33.534604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:33.541771 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:33.542247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:33.542681 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:33.543357 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:33.543806 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:33.544221 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:33.673088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:33.680536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-acbea7fe-1a2b-4d1e-a7ed-2e57706c6679 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.150387 Sep 09 20:38:33.681097 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 451/913] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:33 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:34.703297 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:34.703913 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:34.706574 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 20:38:34.706725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Fri Sep 9 20:38:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca (ip 10.222.0.26) !!! Sep 09 20:38:34.714356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:34.714842 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:34.715277 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:34.715969 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:34.716424 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:34.716849 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:34.853064 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:34.863791 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-817c7c65-1ad8-43d9-bed0-9891a2aac0df tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.164311 Sep 09 20:38:34.864374 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 463/914] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:34 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:35.886462 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:35.887056 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:35.893671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:35.894150 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:35.895172 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:35.895859 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:35.896311 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:35.896731 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:36.029594 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:36.037891 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9fa19fd2-3bc3-40db-b360-e173be2e6fa4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.155609 Sep 09 20:38:36.038453 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 452/915] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:35 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:37.063895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:37.064517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:37.070971 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:37.073067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:37.073592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:37.074005 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:37.074698 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:37.075149 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:37.075569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:37.222075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:37.230405 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-aca54148-602f-48ec-aff6-d91421fda05d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.170599 Sep 09 20:38:37.231122 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 464/916] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:37 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:38.253946 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:38.254553 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:38.256512 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:38.257392 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:38.263867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:38.264351 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:38.264781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:38.265502 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:38.265951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:38.266371 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:38.420739 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:38.429497 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3fe3233d-fd5b-4c04-b01c-8a9537e37b76 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.179209 Sep 09 20:38:38.430161 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 453/917] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:38 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:39.452518 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:39.453703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:39.463172 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:39.463748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:39.464081 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:39.464778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:39.465466 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:39.466010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:39.483910 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-a325ca0c-f52c-415a-9148-2b16361d7aab req-b416d8e3-48a5-4592-8831-e6909e51b4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea398be-0e07-4d50-86af-c37c921b8aca", "name": "network-vif-plugged", "status": "completed", "tag": "e4ac1fe9-a628-4015-bbd3-20c817809bdd"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:39.494962 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a325ca0c-f52c-415a-9148-2b16361d7aab req-b416d8e3-48a5-4592-8831-e6909e51b4f3 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:39.495526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a325ca0c-f52c-415a-9148-2b16361d7aab req-b416d8e3-48a5-4592-8831-e6909e51b4f3 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:39.496072 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-a325ca0c-f52c-415a-9148-2b16361d7aab req-b416d8e3-48a5-4592-8831-e6909e51b4f3 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:39.510889 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-a325ca0c-f52c-415a-9148-2b16361d7aab req-b416d8e3-48a5-4592-8831-e6909e51b4f3 service nova] Creating event network-vif-plugged:e4ac1fe9-a628-4015-bbd3-20c817809bdd for instance 4ea398be-0e07-4d50-86af-c37c921b8aca on hv-cinder-84932 Sep 09 20:38:39.517015 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-a325ca0c-f52c-415a-9148-2b16361d7aab req-b416d8e3-48a5-4592-8831-e6909e51b4f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037789 Sep 09 20:38:39.518230 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 454/918] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:38:39.640458 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:39.649097 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d81c8a95-8bcb-49d7-9fd5-da5f6f47bece tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.200562 Sep 09 20:38:39.650151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 465/919] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:39 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:40.678993 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:40.679756 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:40.685973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:40.686451 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:40.686888 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:40.687602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:40.688059 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:40.688479 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:40.825542 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:40.833831 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7d7b0f83-2d49-4142-a04b-63a2a7e1af28 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1266 microversion: 2.1 time: 0.160291 Sep 09 20:38:40.834403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 455/920] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:40 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:41.857224 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:41.857800 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:41.864398 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:41.864879 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:41.865343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:41.866028 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:41.866485 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:41.866905 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:41.994915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:42.002713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-4021f7c2-f505-4f97-9ca7-2bbc1a6f08e7 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1453 microversion: 2.1 time: 0.149473 Sep 09 20:38:42.003276 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 466/921] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:41 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:42.025508 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:42.026119 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:42.032509 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:42.032990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:42.033463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:42.034152 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:42.034610 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:42.035031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:42.169171 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:42.177560 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f30138ed-53a2-48be-ab32-8f24558a6f0d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1453 microversion: 2.1 time: 0.155502 Sep 09 20:38:42.178294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 456/922] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:42 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:44.130888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f24156e0-ac04-4f65-b426-23ec6c042f2b req-591ab372-2cde-4174-ac75-cdef03e5ded0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea398be-0e07-4d50-86af-c37c921b8aca", "tag": "e4ac1fe9-a628-4015-bbd3-20c817809bdd"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:44.140682 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f24156e0-ac04-4f65-b426-23ec6c042f2b req-591ab372-2cde-4174-ac75-cdef03e5ded0 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:44.141153 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f24156e0-ac04-4f65-b426-23ec6c042f2b req-591ab372-2cde-4174-ac75-cdef03e5ded0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:44.141601 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f24156e0-ac04-4f65-b426-23ec6c042f2b req-591ab372-2cde-4174-ac75-cdef03e5ded0 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:44.153583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f24156e0-ac04-4f65-b426-23ec6c042f2b req-591ab372-2cde-4174-ac75-cdef03e5ded0 service nova] Creating event network-changed:e4ac1fe9-a628-4015-bbd3-20c817809bdd for instance 4ea398be-0e07-4d50-86af-c37c921b8aca on hv-cinder-84932 Sep 09 20:38:44.159075 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f24156e0-ac04-4f65-b426-23ec6c042f2b req-591ab372-2cde-4174-ac75-cdef03e5ded0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169063 Sep 09 20:38:44.160056 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 467/923] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:38:53.690124 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:53.690869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:53.694426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:53.695081 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=74 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:53.701628 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:53.702115 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:53.702549 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:53.703245 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:53.703699 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:53.704117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:53.728408 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lazy-loading 'flavor' on Instance uuid 90b69aea-f2d0-4dec-abe2-3bfa9af1328f {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:38:53.797980 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c538fae0-2405-40f3-8cdb-24614529a756 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "POST /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f/action" status: 202 len: 0 microversion: 2.1 time: 0.111869 Sep 09 20:38:53.798619 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 457/924] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:38:53 2022] POST /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:38:53.808176 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:53.808807 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:53.810856 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:53.817272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:53.817754 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:53.818186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:53.818881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:53.819329 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:53.819753 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:53.822896 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:38:53.960170 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:53.968369 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8007785-38b8-4dee-8473-13cb2b8a51d5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.165255 Sep 09 20:38:53.969008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 468/925] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:53 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:54.752231 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1644493251", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "networks": [{"uuid": "890a1afa-0ed5-46e4-9cef-cd9c6abc66b4"}]}} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:54.804897 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.network.neutron [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] validate_networks() for [('890a1afa-0ed5-46e4-9cef-cd9c6abc66b4', None, None, None, None, None)] {{(pid=120680) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:38:54.991613 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:54.992406 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:54.998926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:54.999487 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:54.999997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:55.000777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:55.001235 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:55.001684 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:55.202914 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:55.211370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-86d3cc91-050c-4a00-94e4-708e2ef103e9 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.223541 Sep 09 20:38:55.211862 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 469/926] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:54 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:38:55.218469 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Flavor limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:38:55.219169 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Image limits 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:38:55.219729 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Flavor pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:38:55.220214 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Image pref 0:0:0 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:38:55.220676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.virt.hardware [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:38:55.230634 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:55.231114 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:55.231580 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:55.232309 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:55.232763 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:55.233184 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:55.249921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Getting quotas for project bbf97f61be434378b04b3f95da86e521. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:38:55.253831 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.quota [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Getting quotas for user 38988b326874436188346c19df131298 and project bbf97f61be434378b04b3f95da86e521. Resources: {'cores', 'ram', 'instances'} {{(pid=120680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:38:55.264564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Going to run 1 instances... {{(pid=120680) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:38:55.266938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:38:55.312758 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a453ca44-83e2-4275-a59c-542355d009ed tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565145 Sep 09 20:38:55.313522 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 458/927] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:38:55.324866 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-38942a16-4230-48f0-b6c0-77c512081afd tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:55.325505 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-38942a16-4230-48f0-b6c0-77c512081afd tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:55.379495 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-38942a16-4230-48f0-b6c0-77c512081afd tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:55.386826 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-38942a16-4230-48f0-b6c0-77c512081afd tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1219 microversion: 2.1 time: 0.065724 Sep 09 20:38:55.387602 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 470/928] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:55 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:56.235308 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:56.235853 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:56.243050 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:56.243542 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:56.243971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:56.244676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:56.245125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:56.245576 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:56.377419 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:56.386745 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-44d1dbc3-a0ca-41fb-9f0e-a4107903afc6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.155601 Sep 09 20:38:56.387298 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 459/929] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:56 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:56.410919 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:56.412182 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:56.418799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:56.419517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:56.420134 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:56.421004 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:56.421652 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:56.422237 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:56.496150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:56.504516 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1945e1b5-c899-445d-8c15-a76eddf73713 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1279 microversion: 2.1 time: 0.098307 Sep 09 20:38:56.505093 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 471/930] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:56 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:57.412147 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:57.412783 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:57.419620 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:57.420113 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:57.420550 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:57.421261 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:57.421727 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:57.422151 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:57.529621 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:57.530242 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:57.537422 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:57.537912 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:57.538348 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:57.539053 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:57.539502 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:57.540150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:57.557808 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:57.567078 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-99caeef8-08e5-4fac-a0ec-341948c75aba tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.159163 Sep 09 20:38:57.567888 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 460/931] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:57 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:38:57.676257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:57.683869 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1e2f45b9-34f4-47a8-b55e-cd921d8c0e71 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.158175 Sep 09 20:38:57.684441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 472/932] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:57 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:38:57.712438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-bf528456-1a32-4b52-baf8-e7a0bfbb22d2 req-5378cf96-ce29-405d-a4ac-4719e5d2127e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0ff27b-5e19-4107-b229-815bd2ebf34b", "tag": "160a2d09-e95c-4bd3-a475-8035c7f04a30"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:38:57.722913 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bf528456-1a32-4b52-baf8-e7a0bfbb22d2 req-5378cf96-ce29-405d-a4ac-4719e5d2127e service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:57.723485 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bf528456-1a32-4b52-baf8-e7a0bfbb22d2 req-5378cf96-ce29-405d-a4ac-4719e5d2127e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:57.724066 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-bf528456-1a32-4b52-baf8-e7a0bfbb22d2 req-5378cf96-ce29-405d-a4ac-4719e5d2127e service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:57.886488 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-bf528456-1a32-4b52-baf8-e7a0bfbb22d2 req-5378cf96-ce29-405d-a4ac-4719e5d2127e service nova] Creating event network-changed:160a2d09-e95c-4bd3-a475-8035c7f04a30 for instance ee0ff27b-5e19-4107-b229-815bd2ebf34b on hv-cinder-84932 Sep 09 20:38:57.891153 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-bf528456-1a32-4b52-baf8-e7a0bfbb22d2 req-5378cf96-ce29-405d-a4ac-4719e5d2127e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182391 Sep 09 20:38:57.891744 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 461/933] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:38:58.591838 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:58.592438 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:58.599324 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:58.599798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:58.600223 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:58.600928 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:58.601401 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:58.601818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:58.708833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:58.709564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:58.715612 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:58.716104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:58.716538 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:58.717234 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:58.717736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:58.718162 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:58.733534 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:58.741583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fe2c815e-cdec-4b2d-8c70-2e193e971c61 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.153570 Sep 09 20:38:58.742150 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 473/934] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:58 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:38:58.844908 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:58.853141 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d52c9be3-d2c3-49aa-ac19-f7819294e240 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.149520 Sep 09 20:38:58.853724 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 462/935] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:58 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:38:59.763711 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:59.764274 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:59.770782 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:59.771271 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:59.771703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:59.772386 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:59.772839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:59.773289 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:59.875905 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:38:59.876526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:38:59.883191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:59.883674 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:59.884134 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:59.884817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:38:59.885281 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:38:59.885699 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:38:59.904410 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:38:59.912804 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-77591ad7-37be-40e2-9cb3-c108247354f0 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.153113 Sep 09 20:38:59.913405 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 474/936] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:59 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:00.011440 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:00.019011 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-86544059-a273-44a1-ae6e-0c30a8aab1c9 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.146924 Sep 09 20:39:00.019559 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 463/937] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:38:59 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:00.936478 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:00.937035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:00.943881 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:00.944363 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:00.944796 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:00.945507 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:00.945961 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:00.946385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:01.041524 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:01.042144 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:01.048691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:01.049197 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:01.049657 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:01.050342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:01.051410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:01.051824 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:01.073795 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:01.081527 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-22671623-cca1-4e90-ba9d-68b67ac78d1f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.148998 Sep 09 20:39:01.082129 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 475/938] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:00 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:01.181137 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:01.188774 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-e37845a7-f1dc-4652-b13c-1692ccd79c9f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.151432 Sep 09 20:39:01.189293 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 464/939] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:01 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:02.104646 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:02.105301 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:02.112942 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:02.113985 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:02.114413 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:02.115124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:02.115571 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:02.115986 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:02.211219 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:02.211836 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:02.218208 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:02.218688 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:02.219125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:02.219928 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:02.220387 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:02.220809 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:02.244345 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:02.252156 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b2124859-8584-45b0-bbb7-b526c2e82d5b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.151469 Sep 09 20:39:02.252821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 476/940] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:02 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:02.355104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:02.362904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-038ac5e2-e78e-4861-80db-7b79bfe1f900 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.155524 Sep 09 20:39:02.364093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 465/941] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:02 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:03.277043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:03.277690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:03.284114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:03.284597 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:03.285033 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:03.285760 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:03.286216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:03.286645 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:03.386432 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:03.387059 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:03.393125 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:03.393638 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:03.394071 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:03.394786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:03.395228 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:03.395639 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:03.415402 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:03.423222 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7b4eb13e-f7fa-4179-b68c-158527d84eb5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.150057 Sep 09 20:39:03.423794 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 477/942] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:03 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:03.526922 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:03.534712 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-531108a9-3588-4723-b010-a84e71c76f95 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.152269 Sep 09 20:39:03.535310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 466/943] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:03 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:03.731217 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-ab06ce7d-4e82-439a-b512-748ddf73e9e0 req-73efcce1-b838-4bfa-b486-913d5cffa9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0ff27b-5e19-4107-b229-815bd2ebf34b", "name": "network-vif-plugged", "status": "completed", "tag": "160a2d09-e95c-4bd3-a475-8035c7f04a30"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:39:03.741520 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ab06ce7d-4e82-439a-b512-748ddf73e9e0 req-73efcce1-b838-4bfa-b486-913d5cffa9bc service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:03.741997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ab06ce7d-4e82-439a-b512-748ddf73e9e0 req-73efcce1-b838-4bfa-b486-913d5cffa9bc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:03.742423 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-ab06ce7d-4e82-439a-b512-748ddf73e9e0 req-73efcce1-b838-4bfa-b486-913d5cffa9bc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:03.752960 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-ab06ce7d-4e82-439a-b512-748ddf73e9e0 req-73efcce1-b838-4bfa-b486-913d5cffa9bc service nova] Creating event network-vif-plugged:160a2d09-e95c-4bd3-a475-8035c7f04a30 for instance ee0ff27b-5e19-4107-b229-815bd2ebf34b on hv-cinder-84932 Sep 09 20:39:03.757892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-ab06ce7d-4e82-439a-b512-748ddf73e9e0 req-73efcce1-b838-4bfa-b486-913d5cffa9bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154428 Sep 09 20:39:03.758464 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 478/944] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:39:04.447054 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:04.447687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:04.454021 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:04.454500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:04.454929 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:04.455611 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:04.456058 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:04.456500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:04.558129 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:04.558825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:04.564912 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:04.565434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:04.565872 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:04.567079 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:04.567526 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:04.567942 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:04.590262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:04.598210 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-c6ca07ac-8343-4f42-ab82-71602ce6c512 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.154976 Sep 09 20:39:04.598773 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 467/945] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:04 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:04.698898 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:04.706517 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e725b0b6-f372-4f6a-b5f3-a248c246f772 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.153131 Sep 09 20:39:04.707713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 479/946] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:04 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:05.621948 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:05.622536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:05.624458 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:05.625105 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=6 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:05.632865 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:05.633626 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:05.634159 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:05.634844 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:05.635290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:05.635708 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:05.730945 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:05.731556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:05.733565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:05.740188 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:05.740670 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:05.741102 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:05.741819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:05.742275 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:05.742699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:05.770054 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:05.778023 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d19b34af-c20f-45d6-b8be-04f3648d9a13 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.159893 Sep 09 20:39:05.778599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 468/947] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:05 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:05.868408 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:05.876908 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9eda925f-3aff-48f7-b1e2-0a9cb36667bf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1319 microversion: 2.1 time: 0.149854 Sep 09 20:39:05.877445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 480/948] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:05 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:06.801193 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:06.801904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:06.808430 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:06.808852 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:06.809321 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:06.810136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:06.810480 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:06.810907 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:06.900424 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:06.901031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:06.907556 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:06.908167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:06.908469 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:06.909157 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:06.909634 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:06.910082 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:06.958978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:06.968361 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-9f22808a-4380-4e47-a497-11eba7407b76 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.171018 Sep 09 20:39:06.968961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 469/949] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:06 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:07.042938 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:07.051414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-1f53dd86-a4a8-4c62-96af-e87e705dc747 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1509 microversion: 2.1 time: 0.154214 Sep 09 20:39:07.051991 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 481/950] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:06 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:07.992621 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:07.993232 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:07.999519 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:08.000099 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:08.000532 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:08.001217 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:08.001686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:08.002104 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:08.134782 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:08.142602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-24008803-237a-4c46-8de8-d75821e80399 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1509 microversion: 2.1 time: 0.154913 Sep 09 20:39:08.143161 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 470/951] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:07 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:08.165496 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:39:08.166099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:08.172453 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:08.172937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:08.173414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:08.174113 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:08.174569 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:08.174997 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:08.261840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120679) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 20:39:08.331008 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8625cbc4-de46-4570-8ed4-3decd7b8d070 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "POST /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f/action" status: 202 len: 0 microversion: 2.1 time: 0.169386 Sep 09 20:39:08.331622 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 482/952] 10.222.0.26 () {60 vars in 1278 bytes} [Fri Sep 9 20:39:08 2022] POST /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:39:08.342582 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:08.343423 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:08.349175 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:08.349690 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:08.350120 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:08.351751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:08.352427 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:08.353100 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:08.497146 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:08.505846 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-83587429-d871-44d0-a1ef-e05fbbbf832d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1517 microversion: 2.1 time: 0.167166 Sep 09 20:39:08.506414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 471/953] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:08 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:09.529441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:09.530079 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:09.537197 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:09.537731 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:09.538185 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:09.538907 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:09.539363 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:09.539798 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:09.680623 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:09.689078 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f8bd5760-093b-407d-907d-9da24566e8d3 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1519 microversion: 2.1 time: 0.164026 Sep 09 20:39:09.689951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 483/954] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:09 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:10.715787 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:10.716505 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:10.723904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:10.724390 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:10.724830 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:10.725564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:10.726019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:10.726441 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:10.860935 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:10.864483 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:10.870077 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4f5032c7-1c73-4e12-a894-6ecc03586100 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1575 microversion: 2.1 time: 0.158285 Sep 09 20:39:10.870636 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 472/955] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:10 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:11.616666 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f9877ca9-e6f0-4872-9cd0-6fc676c16326 req-e0c5c459-7f85-4711-9c86-8a1f24ad0b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b69aea-f2d0-4dec-abe2-3bfa9af1328f", "name": "network-vif-unplugged", "status": "completed", "tag": "bf962b29-7eb7-46b4-a569-cb818262af3e"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:39:11.630370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f9877ca9-e6f0-4872-9cd0-6fc676c16326 req-e0c5c459-7f85-4711-9c86-8a1f24ad0b32 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:11.630922 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f9877ca9-e6f0-4872-9cd0-6fc676c16326 req-e0c5c459-7f85-4711-9c86-8a1f24ad0b32 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:11.631354 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f9877ca9-e6f0-4872-9cd0-6fc676c16326 req-e0c5c459-7f85-4711-9c86-8a1f24ad0b32 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:11.642701 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f9877ca9-e6f0-4872-9cd0-6fc676c16326 req-e0c5c459-7f85-4711-9c86-8a1f24ad0b32 service nova] Creating event network-vif-unplugged:bf962b29-7eb7-46b4-a569-cb818262af3e for instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f on hv-cinder-84932 Sep 09 20:39:11.647680 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f9877ca9-e6f0-4872-9cd0-6fc676c16326 req-e0c5c459-7f85-4711-9c86-8a1f24ad0b32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037498 Sep 09 20:39:11.648257 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 484/956] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:39:11.893668 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:11.894300 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:11.901277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:11.901754 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:11.902188 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:11.902869 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:11.903322 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:11.903766 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:12.037193 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:12.044867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-319c064d-ef00-4ea8-a06d-d7ef69a01433 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1575 microversion: 2.1 time: 0.155749 Sep 09 20:39:12.045451 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 473/957] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:11 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:13.068817 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:13.069541 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:13.076541 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:13.077052 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:13.077513 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:13.078247 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:13.078706 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:13.079138 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:13.219886 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:13.228219 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f8a78eaa-b0f2-47c7-a57c-232742814eb1 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1575 microversion: 2.1 time: 0.163668 Sep 09 20:39:13.228783 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 485/958] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:13 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:14.254762 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:14.255368 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:14.261883 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:14.262368 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:14.262833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:14.263526 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:14.263976 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:14.264408 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:14.400032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:14.407766 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-efb91a30-2436-4387-a5a1-176e2b14a4fc tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1575 microversion: 2.1 time: 0.159268 Sep 09 20:39:14.408316 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 474/959] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:14 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:15.431808 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:15.432372 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:15.438926 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:15.439427 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:15.439856 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:15.440549 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:15.441641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:15.442062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:15.444915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:15.581279 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:15.588838 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7241ba18-0eab-4202-83a8-d8d7d2d534f6 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1575 microversion: 2.1 time: 0.161053 Sep 09 20:39:15.589409 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 486/960] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:15 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:39:16.614646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:16.615266 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:16.625260 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:16.625776 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:16.626283 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:16.626917 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:16.627366 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:16.627785 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:17.028751 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:17.036403 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0cb69aa3-910a-4a97-afc5-7a8106e0a453 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1575 microversion: 2.1 time: 0.426865 Sep 09 20:39:17.036971 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 475/961] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:16 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1575 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:18.059845 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:18.060448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:18.066540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:18.067013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:18.067444 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:18.068120 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:18.068566 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:18.068982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:18.197783 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:18.205419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a7499168-e863-48f5-8316-3d7b345e0250 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1562 microversion: 2.1 time: 0.149526 Sep 09 20:39:18.205986 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 487/962] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:18 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:21.708164 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-71ab9971-6774-4932-be6a-7fcf874b9ffe req-6a5a2e77-b155-4773-bbc5-037133acd2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b69aea-f2d0-4dec-abe2-3bfa9af1328f", "name": "network-vif-plugged", "status": "completed", "tag": "bf962b29-7eb7-46b4-a569-cb818262af3e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:39:21.718375 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-71ab9971-6774-4932-be6a-7fcf874b9ffe req-6a5a2e77-b155-4773-bbc5-037133acd2d2 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:21.718878 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-71ab9971-6774-4932-be6a-7fcf874b9ffe req-6a5a2e77-b155-4773-bbc5-037133acd2d2 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:21.719291 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-71ab9971-6774-4932-be6a-7fcf874b9ffe req-6a5a2e77-b155-4773-bbc5-037133acd2d2 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:21.730872 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-71ab9971-6774-4932-be6a-7fcf874b9ffe req-6a5a2e77-b155-4773-bbc5-037133acd2d2 service nova] Creating event network-vif-plugged:bf962b29-7eb7-46b4-a569-cb818262af3e for instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f on hv-cinder-84932 Sep 09 20:39:21.736117 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-71ab9971-6774-4932-be6a-7fcf874b9ffe req-6a5a2e77-b155-4773-bbc5-037133acd2d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031538 Sep 09 20:39:21.736678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 476/963] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:39:22.449880 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01ef7f3b-0527-4cba-8ccc-d5e953564853", "device": "/dev/sdb"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:39:22.452742 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:22.459169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:22.459641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:22.460070 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:22.460752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:22.461202 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:22.461647 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:22.701952 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89203873-b89b-41e9-82ea-e35ae797b65b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "POST /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255765 Sep 09 20:39:22.702567 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 488/964] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:39:22 2022] POST /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:39:45.343979 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:45.344715 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=20 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:45.349842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:45.350441 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:45.357997 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:45.358473 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:45.358923 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:45.359585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:45.360030 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:45.360448 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:45.440839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lazy-loading 'services' on Instance uuid ee0ff27b-5e19-4107-b229-815bd2ebf34b {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:39:45.510417 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-d6166ce3-7a6f-4054-bd28-263425c951d2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b/os-volume_attachments/01ef7f3b-0527-4cba-8ccc-d5e953564853" status: 202 len: 0 microversion: 2.1 time: 0.167805 Sep 09 20:39:45.511062 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 477/965] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:39:45 2022] DELETE /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b/os-volume_attachments/01ef7f3b-0527-4cba-8ccc-d5e953564853 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:39:46.633906 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:46.634489 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:46.637004 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:46.637689 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:39:46.644965 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:46.645470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:46.645900 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:46.646582 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:46.647031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:46.647448 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:46.675951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:39:46.751813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c887ecbe-a6a6-4ab5-8ca7-c0b8831b3b3a tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 204 len: 0 microversion: 2.1 time: 0.121856 Sep 09 20:39:46.752599 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 489/966] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:39:46 2022] DELETE /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:39:46.761888 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:46.762585 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:46.768694 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:46.769829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:46.770271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:46.770960 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:46.771414 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:46.771835 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:46.901439 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:46.909220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-a35d9864-d95d-4c68-8c7a-7247daabf092 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1515 microversion: 2.1 time: 0.152017 Sep 09 20:39:46.910346 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 478/967] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:46 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:47.932633 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:47.933286 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:47.939675 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:47.940167 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:47.940592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:47.941818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:47.942272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:47.942690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:48.068897 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:48.076589 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-89c26781-84fc-417b-9400-05d2d175610b tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1515 microversion: 2.1 time: 0.148305 Sep 09 20:39:48.077159 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 490/968] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:47 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:48.994686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-91bb858c-746b-42df-ab8d-ae880e58c7ce req-9d65ff08-a207-4c36-b366-f0bf6329345b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0ff27b-5e19-4107-b229-815bd2ebf34b", "name": "network-vif-deleted", "tag": "160a2d09-e95c-4bd3-a475-8035c7f04a30"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:39:49.005362 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-91bb858c-746b-42df-ab8d-ae880e58c7ce req-9d65ff08-a207-4c36-b366-f0bf6329345b service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:49.005842 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-91bb858c-746b-42df-ab8d-ae880e58c7ce req-9d65ff08-a207-4c36-b366-f0bf6329345b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:49.006269 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-91bb858c-746b-42df-ab8d-ae880e58c7ce req-9d65ff08-a207-4c36-b366-f0bf6329345b service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:49.017484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-91bb858c-746b-42df-ab8d-ae880e58c7ce req-9d65ff08-a207-4c36-b366-f0bf6329345b service nova] Creating event network-vif-deleted:160a2d09-e95c-4bd3-a475-8035c7f04a30 for instance ee0ff27b-5e19-4107-b229-815bd2ebf34b on hv-cinder-84932 Sep 09 20:39:49.022294 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-91bb858c-746b-42df-ab8d-ae880e58c7ce req-9d65ff08-a207-4c36-b366-f0bf6329345b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031256 Sep 09 20:39:49.022904 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 479/969] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:39:49.101310 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:49.101908 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:49.107937 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:49.108419 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:49.108846 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:49.109558 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:49.110062 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:49.111095 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:49.145290 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:49.145690 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:49.146116 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:49.146553 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lazy-loading 'fault' on Instance uuid ee0ff27b-5e19-4107-b229-815bd2ebf34b {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:39:49.187866 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:49.196355 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-bfa54363-0f9c-498f-bbde-b89c6e5f3dc2 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 200 len: 1309 microversion: 2.1 time: 0.099987 Sep 09 20:39:49.196916 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 491/970] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:49 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:50.219342 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:50.220032 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: ee0ff27b-5e19-4107-b229-815bd2ebf34b] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:50.226123 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:50.226596 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:50.227024 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:50.227701 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:50.228147 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:50.228564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:50.241709 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] HTTP exception thrown: Instance ee0ff27b-5e19-4107-b229-815bd2ebf34b could not be found. Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Request method failure captured: Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b HTTP/1.1 Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6RdaRR3H0Po-N3UIxxsSAN9kLn1SOINApk0CyWAIo8FffKaTCoy-AWwwfJVJKzpRRcdNF3vWmiJDBMVdtBrRN2m9OljqooqwmZxE2MlNtfSXVzHaZYGiSKnLAgx_wKFOlfQGwYbZlqpXQssLRR7s-fUFk_j7OikHoEzKV1qMBj9BLM Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: bbf97f61be434378b04b3f95da86e521 Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotTestJSON-725141321 Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:39:50.243282 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bbf97f61be434378b04b3f95da86e521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbf97f61be434378b04b3f95da86e521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbf97f61be434378b04b3f95da86e521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bbf97f61be434378b04b3f95da86e521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotTestJSON-725141321 Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: bbf97f61be434378b04b3f95da86e521 Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-725141321 Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotTestJSON-725141321-project Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 38988b326874436188346c19df131298 Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotTestJSON-725141321-project Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance ee0ff27b-5e19-4107-b229-815bd2ebf34b could not be found. Sep 09 20:39:50.244995 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'ee0ff27b-5e19-4107-b229-815bd2ebf34b'} Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0ff27b-5e19-4107-b229-815bd2ebf34b could not be found. Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:39:50.246174 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0ff27b-5e19-4107-b229-815bd2ebf34b could not be found. Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0ff27b-5e19-4107-b229-815bd2ebf34b could not be found. Sep 09 20:39:50.247828 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:39:50.249464 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Returning 404 to user: Instance ee0ff27b-5e19-4107-b229-815bd2ebf34b could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:39:50.249464 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-982f7d67-5520-43d7-b6d8-45c7ed0da6f0 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b" status: 404 len: 111 microversion: 2.1 time: 0.029976 Sep 09 20:39:50.249464 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 480/971] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:50 2022] GET /compute/v2.1/servers/ee0ff27b-5e19-4107-b229-815bd2ebf34b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 20:39:58.020797 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-883853637", "imageRef": "d538b2e3-18d1-4914-ab3e-791d68e27648", "flavorRef": "452", "networks": [{"uuid": "890a1afa-0ed5-46e4-9cef-cd9c6abc66b4"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:39:58.073562 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] validate_networks() for [('890a1afa-0ed5-46e4-9cef-cd9c6abc66b4', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:39:58.420174 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:39:58.420592 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:39:58.421058 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:39:58.421491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:39:58.421895 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:39:58.431183 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:58.431651 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:58.432073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:58.432785 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:58.433230 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:58.433667 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:58.449768 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Getting quotas for project bbf97f61be434378b04b3f95da86e521. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:39:58.453645 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Getting quotas for user 38988b326874436188346c19df131298 and project bbf97f61be434378b04b3f95da86e521. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:39:58.464213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:39:58.466480 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d538b2e3-18d1-4914-ab3e-791d68e27648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:39:58.512238 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a57fe44c-1e84-46d0-9687-f51f223dc85c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495121 Sep 09 20:39:58.512819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 492/972] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:39:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:39:58.523876 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-244a41c0-c0f2-484c-9f71-8321610307fb tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:58.524485 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-244a41c0-c0f2-484c-9f71-8321610307fb tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:58.579025 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-244a41c0-c0f2-484c-9f71-8321610307fb tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:58.585902 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-244a41c0-c0f2-484c-9f71-8321610307fb tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1218 microversion: 2.1 time: 0.065848 Sep 09 20:39:58.586452 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 481/973] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:58 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:39:59.608035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:39:59.608765 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:39:59.616888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:59.617434 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:59.618067 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:59.618901 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:39:59.619370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:39:59.619783 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:39:59.688241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:39:59.696831 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-72b784f3-f3b6-48c4-8e26-2f465be3c4c1 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1288 microversion: 2.1 time: 0.092670 Sep 09 20:39:59.697725 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 493/974] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:39:59 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:00.719982 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:00.720629 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:00.723143 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:00.730126 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:00.730618 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:00.731057 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:00.731766 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:00.732223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:00.732646 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:00.864193 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:00.871176 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f36e2380-4e30-4fe3-b3f1-873d38e0de54 req-73b71fe0-b5e0-4afe-8466-a8b398448a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66e9817-6a92-44c8-bf31-d9b03fd0c65a", "tag": "d66b99bd-b44f-4c19-a715-45c6b3d1853a"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:00.872611 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-f9c8b91e-166c-4bf2-828f-2b786a68d0ba tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1318 microversion: 2.1 time: 0.156529 Sep 09 20:40:00.883688 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f36e2380-4e30-4fe3-b3f1-873d38e0de54 req-73b71fe0-b5e0-4afe-8466-a8b398448a92 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:00.884356 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f36e2380-4e30-4fe3-b3f1-873d38e0de54 req-73b71fe0-b5e0-4afe-8466-a8b398448a92 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:00.885057 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f36e2380-4e30-4fe3-b3f1-873d38e0de54 req-73b71fe0-b5e0-4afe-8466-a8b398448a92 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:00.889328 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 482/975] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:00 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:00.897628 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f36e2380-4e30-4fe3-b3f1-873d38e0de54 req-73b71fe0-b5e0-4afe-8466-a8b398448a92 service nova] Creating event network-changed:d66b99bd-b44f-4c19-a715-45c6b3d1853a for instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a on hv-cinder-84932 Sep 09 20:40:00.903635 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f36e2380-4e30-4fe3-b3f1-873d38e0de54 req-73b71fe0-b5e0-4afe-8466-a8b398448a92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035834 Sep 09 20:40:00.904988 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 494/976] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:01.895923 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:01.896538 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:01.902954 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:01.903435 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:01.903868 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:01.904552 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:01.905006 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:01.905458 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:02.031805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:02.039382 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-2c6dbf7b-bdfb-4a89-874a-b0696c075048 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1318 microversion: 2.1 time: 0.147289 Sep 09 20:40:02.040181 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 483/977] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:01 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:03.064272 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:03.064979 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:03.071175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:03.071659 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:03.072096 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:03.072790 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:03.073261 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:03.073693 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:03.199804 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:03.207974 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-c9e7c31e-1f1a-4ee3-917c-89958fcd8fcf tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1318 microversion: 2.1 time: 0.148419 Sep 09 20:40:03.208540 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 495/978] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:03 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:04.230988 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:04.231601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:04.238864 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:04.239345 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:04.239781 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:04.240467 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:04.240950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:04.241476 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:04.373618 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:04.381285 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-4e45aaef-f26a-4e94-a7c0-ceba7f819f9d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1318 microversion: 2.1 time: 0.154232 Sep 09 20:40:04.381850 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 484/979] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:04 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:05.403924 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:05.404530 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:05.411470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:05.411945 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:05.412372 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:05.413051 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:05.413523 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:05.413940 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:05.542349 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:05.549992 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-7dfc279c-3f60-4c91-bc9b-2e704f7ce741 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1318 microversion: 2.1 time: 0.149904 Sep 09 20:40:05.550564 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 496/980] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:05 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:05.953614 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cf19e31d-7d9f-4f2d-a631-3ec20bd7c21d req-9f4eaa77-6d6c-4865-b9c2-3e196f2e54dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66e9817-6a92-44c8-bf31-d9b03fd0c65a", "name": "network-vif-plugged", "status": "completed", "tag": "d66b99bd-b44f-4c19-a715-45c6b3d1853a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:05.963773 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf19e31d-7d9f-4f2d-a631-3ec20bd7c21d req-9f4eaa77-6d6c-4865-b9c2-3e196f2e54dc service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:05.964269 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf19e31d-7d9f-4f2d-a631-3ec20bd7c21d req-9f4eaa77-6d6c-4865-b9c2-3e196f2e54dc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:05.964845 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cf19e31d-7d9f-4f2d-a631-3ec20bd7c21d req-9f4eaa77-6d6c-4865-b9c2-3e196f2e54dc service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:05.976564 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cf19e31d-7d9f-4f2d-a631-3ec20bd7c21d req-9f4eaa77-6d6c-4865-b9c2-3e196f2e54dc service nova] Creating event network-vif-plugged:d66b99bd-b44f-4c19-a715-45c6b3d1853a for instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a on hv-cinder-84932 Sep 09 20:40:05.981395 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cf19e31d-7d9f-4f2d-a631-3ec20bd7c21d req-9f4eaa77-6d6c-4865-b9c2-3e196f2e54dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Sep 09 20:40:05.981980 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 485/981] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:06.572605 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:06.573270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:06.579716 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:06.580186 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:06.580612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:06.581953 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:06.582400 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:06.582813 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:06.721125 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:06.728944 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3eaf378a-5add-46cc-9c78-b740b6ba3d63 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1318 microversion: 2.1 time: 0.160211 Sep 09 20:40:06.729542 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 497/982] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:06 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:07.752041 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:07.752731 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:07.759482 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:07.759959 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:07.760388 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:07.761093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:07.761569 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:07.761990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:07.888008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:07.895671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-dd3ef165-271d-4a51-857a-0fbab9807985 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1508 microversion: 2.1 time: 0.148361 Sep 09 20:40:07.896223 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 486/983] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:07 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:07.917767 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db51f84f-7084-4187-a901-ea4dc3e5be22", "device": "/dev/sdb"}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:07.920232 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:07.927285 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:07.927702 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:07.928135 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:07.928820 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:07.929291 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:07.929717 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:08.165212 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2ab2e524-43fa-4e71-884f-c1ebeafaa317 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "POST /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251228 Sep 09 20:40:08.165882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 498/984] 10.222.0.26 () {60 vars in 1323 bytes} [Fri Sep 9 20:40:07 2022] POST /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:26.491873 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:26.492410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:26.494382 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:26.495587 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=22 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:26.496238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=26 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:26.502364 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:26.502841 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:26.503267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:26.503950 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:26.504398 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:26.504817 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:26.587687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.objects.instance [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lazy-loading 'services' on Instance uuid a66e9817-6a92-44c8-bf31-d9b03fd0c65a {{(pid=120680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:40:26.665936 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-da27985a-18cc-4971-92fb-da0b2d41748f tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a/os-volume_attachments/db51f84f-7084-4187-a901-ea4dc3e5be22" status: 202 len: 0 microversion: 2.1 time: 0.177354 Sep 09 20:40:26.666641 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 487/985] 10.222.0.26 () {58 vars in 1416 bytes} [Fri Sep 9 20:40:26 2022] DELETE /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a/os-volume_attachments/db51f84f-7084-4187-a901-ea4dc3e5be22 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:40:27.784043 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:27.784793 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:27.785682 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 20:40:27.785884 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Fri Sep 9 20:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a (ip 10.222.0.26) !!! Sep 09 20:40:27.787180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:27.788083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:27.792564 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:27.793155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:27.804899 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:27.805399 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:27.805825 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:27.806506 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:27.806951 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:27.807365 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:27.834565 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:40:27.906560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a16b3a02-000a-4bff-891a-ec3d31bfb097 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 204 len: 0 microversion: 2.1 time: 0.123625 Sep 09 20:40:27.907145 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 499/986] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:40:27 2022] DELETE /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:40:27.916870 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:27.917599 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:27.923843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:27.924270 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:27.924747 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:27.925961 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:27.926413 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:27.926833 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:28.053185 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:28.060793 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-51e644e6-aaaf-4ca8-a94a-91807731935c tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1514 microversion: 2.1 time: 0.148635 Sep 09 20:40:28.061372 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 488/987] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:27 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:40:29.084055 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:29.084779 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:29.091134 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:29.091614 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:29.092044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:29.092737 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:29.093191 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:29.093639 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:29.234083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:29.242641 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a0397c21-b445-45be-8f16-d4a4ab8b35a6 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1514 microversion: 2.1 time: 0.162924 Sep 09 20:40:29.243203 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 500/988] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:29 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:30.264671 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:30.265284 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:30.271676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:30.272150 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:30.272579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:30.273267 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:30.273719 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:30.274135 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:30.401169 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:30.409069 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7f64d919-d3be-408c-9a80-9fa875a2b62d tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1514 microversion: 2.1 time: 0.148225 Sep 09 20:40:30.409674 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 489/989] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:30 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:31.432169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:31.432839 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:31.439338 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:31.439818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:31.440246 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:31.440927 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:31.441426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:31.441870 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:31.575488 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:31.583498 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a3ea71ef-ace2-4192-a8bd-13da76cdfcf3 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1514 microversion: 2.1 time: 0.155327 Sep 09 20:40:31.596777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 501/990] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:31 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:32.211016 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-cbb3bbed-99ec-488c-9a16-1a8d5e473ab7 req-d4352eb9-057b-4de3-8719-a4b0b6f60e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66e9817-6a92-44c8-bf31-d9b03fd0c65a", "name": "network-vif-deleted", "tag": "d66b99bd-b44f-4c19-a715-45c6b3d1853a"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:32.221292 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cbb3bbed-99ec-488c-9a16-1a8d5e473ab7 req-d4352eb9-057b-4de3-8719-a4b0b6f60e73 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:32.221769 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cbb3bbed-99ec-488c-9a16-1a8d5e473ab7 req-d4352eb9-057b-4de3-8719-a4b0b6f60e73 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:32.222191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-cbb3bbed-99ec-488c-9a16-1a8d5e473ab7 req-d4352eb9-057b-4de3-8719-a4b0b6f60e73 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:32.233990 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-cbb3bbed-99ec-488c-9a16-1a8d5e473ab7 req-d4352eb9-057b-4de3-8719-a4b0b6f60e73 service nova] Creating event network-vif-deleted:d66b99bd-b44f-4c19-a715-45c6b3d1853a for instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a on hv-cinder-84932 Sep 09 20:40:32.239887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-cbb3bbed-99ec-488c-9a16-1a8d5e473ab7 req-d4352eb9-057b-4de3-8719-a4b0b6f60e73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032595 Sep 09 20:40:32.240474 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 490/991] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:32.606248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:32.606888 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:32.613493 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:32.613976 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:32.614414 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:32.615101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:32.615555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:32.615978 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:32.645861 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:32.646263 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:32.646692 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:32.647236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.objects.instance [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lazy-loading 'fault' on Instance uuid a66e9817-6a92-44c8-bf31-d9b03fd0c65a {{(pid=120679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 20:40:32.690966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38988b326874436188346c19df131298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf97f61be434378b04b3f95da86e521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:32.698647 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-f0184087-4d69-47af-bd40-26abb92974c4 tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 200 len: 1308 microversion: 2.1 time: 0.096313 Sep 09 20:40:32.699212 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 502/992] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:32 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:33.723319 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:33.724036 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] [instance: a66e9817-6a92-44c8-bf31-d9b03fd0c65a] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:33.730191 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:33.730678 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:33.731114 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:33.731803 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:33.732262 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:33.732687 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:33.746645 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] HTTP exception thrown: Instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a could not be found. Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Request method failure captured: Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a HTTP/1.1 Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6RdaRR3H0Po-N3UIxxsSAN9kLn1SOINApk0CyWAIo8FffKaTCoy-AWwwfJVJKzpRRcdNF3vWmiJDBMVdtBrRN2m9OljqooqwmZxE2MlNtfSXVzHaZYGiSKnLAgx_wKFOlfQGwYbZlqpXQssLRR7s-fUFk_j7OikHoEzKV1qMBj9BLM Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: bbf97f61be434378b04b3f95da86e521 Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-VolumesSnapshotTestJSON-725141321 Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:40:33.748277 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bbf97f61be434378b04b3f95da86e521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbf97f61be434378b04b3f95da86e521"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbf97f61be434378b04b3f95da86e521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bbf97f61be434378b04b3f95da86e521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-VolumesSnapshotTestJSON-725141321 Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: bbf97f61be434378b04b3f95da86e521 Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-725141321 Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-VolumesSnapshotTestJSON-725141321-project Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 38988b326874436188346c19df131298 Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-VolumesSnapshotTestJSON-725141321-project Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a could not be found. Sep 09 20:40:33.749967 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'a66e9817-6a92-44c8-bf31-d9b03fd0c65a'} Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a could not be found. Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:40:33.750877 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a could not be found. Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a could not be found. Sep 09 20:40:33.752493 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:40:33.754116 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] Returning 404 to user: Instance a66e9817-6a92-44c8-bf31-d9b03fd0c65a could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:40:33.754116 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-75221047-4863-441b-8418-1c8e65f3002e tempest-VolumesSnapshotTestJSON-725141321 tempest-VolumesSnapshotTestJSON-725141321-project] 10.222.0.26 "GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a" status: 404 len: 111 microversion: 2.1 time: 0.031574 Sep 09 20:40:33.754116 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 491/993] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:33 2022] GET /compute/v2.1/servers/a66e9817-6a92-44c8-bf31-d9b03fd0c65a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:40:35.152036 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-850111389", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1370114658", "security_groups": [{"name": "tempest-secgroup-smoke-1813791276"}], "block_device_mapping_v2": [{"uuid": "e1abc700-0ef4-4bd8-b109-a5c0805cbba9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59e2f46b-26f1-41b6-a478-bcc0b9346326"}]}} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:35.278924 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.network.neutron [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] validate_networks() for [('59e2f46b-26f1-41b6-a478-bcc0b9346326', None, None, None, None, None)] {{(pid=120679) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 20:40:35.638799 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Flavor limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 20:40:35.639215 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Image limits 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 20:40:35.639699 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Flavor pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 20:40:35.640097 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Image pref 0:0:0 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 20:40:35.640499 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.virt.hardware [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 20:40:35.649124 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:35.649627 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:35.650053 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:35.650766 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:35.651206 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:35.651619 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:35.667891 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 20:40:35.671834 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.quota [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Getting quotas for user 63371d392c8c4b73939ee73a1627c8dd and project 7e12f0c37bd14176b04dfd87d7b10520. Resources: {'cores', 'ram', 'instances'} {{(pid=120679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 20:40:35.728095 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Going to run 1 instances... {{(pid=120679) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 20:40:35.730280 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1abc700-0ef4-4bd8-b109-a5c0805cbba9',volume_size=None,volume_type=None)] {{(pid=120679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 20:40:35.858691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-61d93667-c206-470e-8a4e-40aeed962f30 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712354 Sep 09 20:40:35.859340 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 503/994] 10.222.0.26 () {60 vars in 1147 bytes} [Fri Sep 9 20:40:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 20:40:35.871139 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-b6e1d76c-cb68-4c5b-a3e4-0016a6bf92c3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:35.871753 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-b6e1d76c-cb68-4c5b-a3e4-0016a6bf92c3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:35.929068 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-b6e1d76c-cb68-4c5b-a3e4-0016a6bf92c3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:35.938848 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-b6e1d76c-cb68-4c5b-a3e4-0016a6bf92c3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1094 microversion: 2.1 time: 0.071496 Sep 09 20:40:35.939412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 492/995] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:35 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:36.961509 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:36.962213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:36.968233 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:36.968701 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:36.969130 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:36.969837 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:36.970286 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:36.970703 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:37.031957 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:37.040300 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-e5d6249c-913b-4f13-9646-4390fe8d0380 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1144 microversion: 2.1 time: 0.083667 Sep 09 20:40:37.040887 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 504/996] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:36 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:38.115640 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:38.116290 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:38.122338 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:38.122819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:38.123251 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:38.123941 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:38.124401 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:38.124829 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:38.183920 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:38.192605 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-df108921-ce4e-442d-9994-095781203ec6 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1144 microversion: 2.1 time: 0.134458 Sep 09 20:40:38.193208 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 493/997] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:38 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:39.216105 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:39.218826 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:39.227505 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:39.228446 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:39.229123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:39.230726 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:39.231479 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:39.232593 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:39.295283 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:39.303193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-78289724-0fd5-4ad5-b33b-2e8c03d16517 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1210 microversion: 2.1 time: 0.091404 Sep 09 20:40:39.303752 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 505/998] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:39 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:40:40.326799 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:40.327746 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:40.334499 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:40.334975 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:40.335406 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:40.336088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:40.336535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:40.336953 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:40.470770 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:40.478708 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-87a8dbef-e479-4b31-9f27-f1b5dde7fe9e tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.156267 Sep 09 20:40:40.479227 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 494/999] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:40 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:40.518811 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-2a366763-cc81-4d31-a246-8bbb85b05696 req-db44af58-c9b8-438c-b81b-5aa99facdfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d827923-ffce-4e41-bb2e-7955767c159e", "tag": "9a3872b5-a833-46a8-9c39-a7777f2a1371"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:40.530552 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a366763-cc81-4d31-a246-8bbb85b05696 req-db44af58-c9b8-438c-b81b-5aa99facdfb5 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:40.531111 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a366763-cc81-4d31-a246-8bbb85b05696 req-db44af58-c9b8-438c-b81b-5aa99facdfb5 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:40.531605 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-2a366763-cc81-4d31-a246-8bbb85b05696 req-db44af58-c9b8-438c-b81b-5aa99facdfb5 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:40.542732 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-2a366763-cc81-4d31-a246-8bbb85b05696 req-db44af58-c9b8-438c-b81b-5aa99facdfb5 service nova] Creating event network-changed:9a3872b5-a833-46a8-9c39-a7777f2a1371 for instance 3d827923-ffce-4e41-bb2e-7955767c159e on hv-cinder-84932 Sep 09 20:40:40.547470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-2a366763-cc81-4d31-a246-8bbb85b05696 req-db44af58-c9b8-438c-b81b-5aa99facdfb5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032413 Sep 09 20:40:40.548078 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 506/1000] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:41.502082 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:41.502704 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:41.509062 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:41.509579 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:41.510019 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:41.510707 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:41.511247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:41.511587 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:41.642088 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:41.650429 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-81eeefb3-2529-4c67-b763-cbbe96196be0 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.152159 Sep 09 20:40:41.651002 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 495/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:41 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:42.674579 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:42.675273 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:42.682306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:42.682778 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:42.683207 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:42.683921 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:42.684330 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:42.684746 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:42.823195 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:42.830875 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-a78610fe-f03d-4c18-9891-afbe5a90848f tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.161098 Sep 09 20:40:42.831447 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 507/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:42 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:43.853068 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:43.853688 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:43.860103 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:43.860583 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:43.861017 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:43.861986 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:43.862438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:43.862860 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:44.001312 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:44.009812 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-48102f5a-ed36-4cb8-af85-beaf82f7a58d tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.160586 Sep 09 20:40:44.010383 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 496/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:43 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:45.031503 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:45.032129 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:45.039004 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:45.039483 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:45.039911 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:45.040590 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:45.041035 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:45.041498 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:45.168317 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:45.176040 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-2b571dcf-85df-4446-abe0-e2660a39886a tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.148404 Sep 09 20:40:45.176599 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 508/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:45 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:46.201365 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:46.202046 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:46.205138 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell0:SELECT=2 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:46.213717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:46.214461 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:46.215256 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:46.216304 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:46.217022 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:46.217805 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:46.351500 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:46.359396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-7aa37e0e-1b17-459e-b043-fd083823f4d9 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.164056 Sep 09 20:40:46.359973 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 497/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:46 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:47.162904 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:47.163420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:47.168325 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-926f2cf1-9a28-4034-86d6-badda20eca05 req-248f7b94-f41e-4497-b50f-a957e585c837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b69aea-f2d0-4dec-abe2-3bfa9af1328f", "tag": "bf962b29-7eb7-46b4-a569-cb818262af3e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:47.175606 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:47.177101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell0:SELECT=6 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:47.183615 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-926f2cf1-9a28-4034-86d6-badda20eca05 req-248f7b94-f41e-4497-b50f-a957e585c837 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:47.184047 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:47.184265 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-926f2cf1-9a28-4034-86d6-badda20eca05 req-248f7b94-f41e-4497-b50f-a957e585c837 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:47.184546 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:47.184677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-926f2cf1-9a28-4034-86d6-badda20eca05 req-248f7b94-f41e-4497-b50f-a957e585c837 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:47.184975 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:47.185856 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:47.186155 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:47.186776 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:47.196680 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-926f2cf1-9a28-4034-86d6-badda20eca05 req-248f7b94-f41e-4497-b50f-a957e585c837 service nova] Creating event network-changed:bf962b29-7eb7-46b4-a569-cb818262af3e for instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f on hv-cinder-84932 Sep 09 20:40:47.202026 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-926f2cf1-9a28-4034-86d6-badda20eca05 req-248f7b94-f41e-4497-b50f-a957e585c837 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037159 Sep 09 20:40:47.203045 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 498/1006] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:47.214101 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:40:47.294131 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-74f00839-718f-4540-9a22-f5d78392c767 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 204 len: 0 microversion: 2.1 time: 0.135540 Sep 09 20:40:47.294720 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 509/1007] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:40:47 2022] DELETE /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:40:47.303893 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:47.304677 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:47.311093 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:47.311811 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:47.312250 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:47.312941 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:47.313586 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:47.314190 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:47.384147 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:47.385532 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:47.392114 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:47.392604 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:47.393060 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:47.393783 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:47.394240 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:47.395248 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:47.485323 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:47.494221 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3fb7e6df-8a49-444e-b160-01442ca0f9e5 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.194888 Sep 09 20:40:47.494795 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 499/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:47 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:47.548631 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:47.557123 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-d8944880-ad39-4f7f-baf7-95eaff0670ec tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.177980 Sep 09 20:40:47.557840 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 510/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:47 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:40:48.518224 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:48.518819 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:48.526201 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:48.526686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:48.527122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:48.527821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:48.528271 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:48.528695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:48.580137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:48.580748 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:48.589216 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:48.589843 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:48.590358 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:48.591143 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:48.591626 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:48.592042 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:48.705025 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:48.713934 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-22e59287-6b0d-440c-9b4c-0e813e6e093b tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1568 microversion: 2.1 time: 0.199693 Sep 09 20:40:48.714635 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 500/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:48 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:48.760743 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:48.768821 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-21580291-431f-42c5-a385-7b0909d18361 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.192633 Sep 09 20:40:48.769352 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 511/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:48 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:40:49.604684 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e419c6de-5ceb-469d-8c90-c4428052c504 req-bde3fa1e-6b32-4aa7-ad27-dab3513547cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b69aea-f2d0-4dec-abe2-3bfa9af1328f", "name": "network-vif-deleted", "tag": "bf962b29-7eb7-46b4-a569-cb818262af3e"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:49.614717 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e419c6de-5ceb-469d-8c90-c4428052c504 req-bde3fa1e-6b32-4aa7-ad27-dab3513547cf service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:49.615412 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e419c6de-5ceb-469d-8c90-c4428052c504 req-bde3fa1e-6b32-4aa7-ad27-dab3513547cf service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:49.615867 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e419c6de-5ceb-469d-8c90-c4428052c504 req-bde3fa1e-6b32-4aa7-ad27-dab3513547cf service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:49.627238 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e419c6de-5ceb-469d-8c90-c4428052c504 req-bde3fa1e-6b32-4aa7-ad27-dab3513547cf service nova] Creating event network-vif-deleted:bf962b29-7eb7-46b4-a569-cb818262af3e for instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f on hv-cinder-84932 Sep 09 20:40:49.632626 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e419c6de-5ceb-469d-8c90-c4428052c504 req-bde3fa1e-6b32-4aa7-ad27-dab3513547cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031859 Sep 09 20:40:49.633207 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 501/1012] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:49.737015 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:49.737681 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:49.744451 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:49.744929 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:49.745528 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:49.746213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:49.746664 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:49.747083 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:49.792650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:49.793268 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:49.799692 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:49.800187 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:49.800624 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:49.801856 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:49.802310 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:49.802733 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:49.809385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3540adbd8efb4a7a97ca44a6c0e5e51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474aa97f67a8457ab6900081711a0bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:49.819474 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-9baf6573-0a22-4fc4-89aa-11ed04ac935d tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 200 len: 1219 microversion: 2.1 time: 0.086512 Sep 09 20:40:49.835229 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 512/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:49 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:49.947651 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:49.956838 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-6ea6276d-bd43-4d34-9906-1acf87025916 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.167573 Sep 09 20:40:49.957112 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 502/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:49 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:40:50.842894 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:50.843744 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] [instance: 90b69aea-f2d0-4dec-abe2-3bfa9af1328f] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:50.850694 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:50.851175 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:50.851611 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:50.852295 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:50.852812 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:50.853234 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:50.857202 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:50.867954 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] HTTP exception thrown: Instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f could not be found. Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Request method failure captured: Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f HTTP/1.1 Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6PAfCQ3mIskhaLoL2EyX9CCMIr20DxEpWNakAQxI_iu6q5WZ_bN1t8pAACQQQMwM_xtrWEFnzZhmVGcZfN5Hjcp8EtYRaeH1ESQ8FgtChrNz_DEUBL4_YqKqN7ko2rYkEahCUkmkJnHTg6oVOUavEr-JHiKmzGsd3fXCHtuvk78akk Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 474aa97f67a8457ab6900081711a0bf1 Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-TestShelveInstance-772729787 Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:40:50.869581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/474aa97f67a8457ab6900081711a0bf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/474aa97f67a8457ab6900081711a0bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/474aa97f67a8457ab6900081711a0bf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_474aa97f67a8457ab6900081711a0bf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-TestShelveInstance-772729787 Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 474aa97f67a8457ab6900081711a0bf1 Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestShelveInstance-772729787 Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-TestShelveInstance-772729787-project Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 3540adbd8efb4a7a97ca44a6c0e5e51d Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-TestShelveInstance-772729787-project Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f could not be found. Sep 09 20:40:50.871347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '90b69aea-f2d0-4dec-abe2-3bfa9af1328f'} Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f could not be found. Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:40:50.872326 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f could not be found. Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f could not be found. Sep 09 20:40:50.873999 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:40:50.875555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Returning 404 to user: Instance 90b69aea-f2d0-4dec-abe2-3bfa9af1328f could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:40:50.875555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-5138a82b-8df4-46fe-b323-b0c407ba34d8 tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f" status: 404 len: 111 microversion: 2.1 time: 0.032062 Sep 09 20:40:50.875555 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 513/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:50 2022] GET /compute/v2.1/servers/90b69aea-f2d0-4dec-abe2-3bfa9af1328f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:40:50.978438 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:50.979079 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:50.986236 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:50.986723 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:50.987426 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:50.988122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:50.989106 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:50.989555 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:51.037918 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-40f6ff05-d781-4a0f-8e95-efe99077456f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] Calling method '.version_select at 0x7f4834dfda60>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:51.074479 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-40f6ff05-d781-4a0f-8e95-efe99077456f tempest-TestShelveInstance-772729787 tempest-TestShelveInstance-772729787-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1917405346" status: 202 len: 0 microversion: 2.1 time: 0.040994 Sep 09 20:40:51.075270 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 514/1016] 10.222.0.26 () {58 vars in 1254 bytes} [Fri Sep 9 20:40:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1917405346 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 20:40:51.211978 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:51.219878 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-78fe6a85-8671-4319-84f4-21a1b9a16422 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.245340 Sep 09 20:40:51.220445 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 503/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:50 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:52.188342 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-763de136-6c21-4610-90d0-a17703d04766 req-f05b2176-6c86-4228-b97c-0086524d505d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d827923-ffce-4e41-bb2e-7955767c159e", "name": "network-vif-plugged", "status": "completed", "tag": "9a3872b5-a833-46a8-9c39-a7777f2a1371"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:52.199537 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-763de136-6c21-4610-90d0-a17703d04766 req-f05b2176-6c86-4228-b97c-0086524d505d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:52.200250 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-763de136-6c21-4610-90d0-a17703d04766 req-f05b2176-6c86-4228-b97c-0086524d505d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:52.200674 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-763de136-6c21-4610-90d0-a17703d04766 req-f05b2176-6c86-4228-b97c-0086524d505d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:52.211868 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-763de136-6c21-4610-90d0-a17703d04766 req-f05b2176-6c86-4228-b97c-0086524d505d service nova] Creating event network-vif-plugged:9a3872b5-a833-46a8-9c39-a7777f2a1371 for instance 3d827923-ffce-4e41-bb2e-7955767c159e on hv-cinder-84932 Sep 09 20:40:52.216818 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-763de136-6c21-4610-90d0-a17703d04766 req-f05b2176-6c86-4228-b97c-0086524d505d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Sep 09 20:40:52.217370 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 515/1018] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:40:52.249205 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:52.250484 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:52.264295 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:52.265287 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:52.265839 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:52.267154 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:52.268068 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:52.268945 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:52.485203 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:52.493604 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-003fbc03-3144-4c00-a5d2-f441448b8dae tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.252547 Sep 09 20:40:52.509109 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 504/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:52 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:53.517668 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:53.519013 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:53.530713 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:53.534762 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:53.535852 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:53.536877 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:53.537539 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:53.538097 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:53.706560 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:53.714912 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-775197c9-9873-463a-89fd-453251174d14 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1266 microversion: 2.1 time: 0.202571 Sep 09 20:40:53.715622 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 516/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:53 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:54.738812 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:54.739424 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:54.746302 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:54.746786 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:54.747220 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:54.747991 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:54.748547 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:54.748979 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:54.889140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:54.898314 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-82905f7f-718d-4b9f-a187-10da7c606cb5 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1454 microversion: 2.1 time: 0.163800 Sep 09 20:40:54.899301 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 505/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:54 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:54.920151 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:40:54.920815 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:40:54.927973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:54.928449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:54.928876 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:54.929664 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:54.930110 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:54.930522 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:55.081757 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:40:55.090973 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-da04bcfb-754f-4ca0-8e59-df276e223d62 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1454 microversion: 2.1 time: 0.174573 Sep 09 20:40:55.093501 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 517/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:40:54 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:40:56.895422 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-b62c0447-bd8d-47b8-ad9c-2420eb0be160 req-8d447973-1c90-4775-b41f-e1c927fce1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d827923-ffce-4e41-bb2e-7955767c159e", "tag": "9a3872b5-a833-46a8-9c39-a7777f2a1371"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:40:56.901861 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=41 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:56.906767 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b62c0447-bd8d-47b8-ad9c-2420eb0be160 req-8d447973-1c90-4775-b41f-e1c927fce1ad service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:40:56.907255 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b62c0447-bd8d-47b8-ad9c-2420eb0be160 req-8d447973-1c90-4775-b41f-e1c927fce1ad service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:40:56.907691 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-b62c0447-bd8d-47b8-ad9c-2420eb0be160 req-8d447973-1c90-4775-b41f-e1c927fce1ad service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:40:56.912826 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:40:56.924098 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-b62c0447-bd8d-47b8-ad9c-2420eb0be160 req-8d447973-1c90-4775-b41f-e1c927fce1ad service nova] Creating event network-changed:9a3872b5-a833-46a8-9c39-a7777f2a1371 for instance 3d827923-ffce-4e41-bb2e-7955767c159e on hv-cinder-84932 Sep 09 20:40:56.930396 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-b62c0447-bd8d-47b8-ad9c-2420eb0be160 req-8d447973-1c90-4775-b41f-e1c927fce1ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099855 Sep 09 20:40:56.931588 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 506/1023] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:42:25.334331 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 20:42:25.335060 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Fri Sep 9 20:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 09 20:42:25.336385 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.337193 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG dbcounter [-] [120679] Writing DB stats nova_cell1:SELECT=14 {{(pid=120679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.342137 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:25.343087 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG dbcounter [-] [120680] Writing DB stats nova_api:SELECT=1 {{(pid=120680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.344288 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 20:42:25.344503 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Fri Sep 9 20:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 09 20:42:25.351650 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-e6b21a2c-379f-4385-a467-eb6bc024c050 req-6e7a5929-ef21-40f5-bef2-2a9e2e2f5a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d827923-ffce-4e41-bb2e-7955767c159e", "tag": "9a3872b5-a833-46a8-9c39-a7777f2a1371"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:42:25.352345 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:25.360470 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:25.360964 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:25.361426 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:25.362131 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:25.362583 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:25.363021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:25.378676 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e6b21a2c-379f-4385-a467-eb6bc024c050 req-6e7a5929-ef21-40f5-bef2-2a9e2e2f5a8d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:25.379155 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e6b21a2c-379f-4385-a467-eb6bc024c050 req-6e7a5929-ef21-40f5-bef2-2a9e2e2f5a8d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:25.380247 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-e6b21a2c-379f-4385-a467-eb6bc024c050 req-6e7a5929-ef21-40f5-bef2-2a9e2e2f5a8d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:25.392938 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-e6b21a2c-379f-4385-a467-eb6bc024c050 req-6e7a5929-ef21-40f5-bef2-2a9e2e2f5a8d service nova] Creating event network-changed:9a3872b5-a833-46a8-9c39-a7777f2a1371 for instance 3d827923-ffce-4e41-bb2e-7955767c159e on hv-cinder-84932 Sep 09 20:42:25.398581 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:42:25.398834 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-e6b21a2c-379f-4385-a467-eb6bc024c050 req-6e7a5929-ef21-40f5-bef2-2a9e2e2f5a8d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066864 Sep 09 20:42:25.399562 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 507/1024] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:42:25.489445 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-fc2ec986-f817-4d6d-820b-037947647e7c tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 204 len: 0 microversion: 2.1 time: 0.158487 Sep 09 20:42:25.490296 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 518/1025] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:42:25 2022] DELETE /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:25.499043 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:25.499736 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:25.506573 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:25.507061 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:25.507496 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:25.508449 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:25.508899 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:25.509515 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:25.646482 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:42:25.654644 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-859264ea-9de3-4330-bf50-057e45c5eeed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1578 microversion: 2.1 time: 0.159825 Sep 09 20:42:25.655256 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 508/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:25 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:26.679354 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:26.680044 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:26.686439 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:26.686915 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:26.687343 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:26.688021 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:26.688467 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:26.688882 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:26.824236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:42:26.832073 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-8b48750e-8d64-4b9d-84d2-d0ec2a22ead1 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1578 microversion: 2.1 time: 0.157003 Sep 09 20:42:26.833146 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 519/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:26 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:27.769410 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-c07498dc-3051-49e3-b7d3-b6a4181d5441 req-79b1338a-1d63-4ed3-bae1-486a4976571c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d827923-ffce-4e41-bb2e-7955767c159e", "name": "network-vif-deleted", "tag": "9a3872b5-a833-46a8-9c39-a7777f2a1371"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:42:27.779235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c07498dc-3051-49e3-b7d3-b6a4181d5441 req-79b1338a-1d63-4ed3-bae1-486a4976571c service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:27.779712 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c07498dc-3051-49e3-b7d3-b6a4181d5441 req-79b1338a-1d63-4ed3-bae1-486a4976571c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:27.780140 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-c07498dc-3051-49e3-b7d3-b6a4181d5441 req-79b1338a-1d63-4ed3-bae1-486a4976571c service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:27.791590 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-c07498dc-3051-49e3-b7d3-b6a4181d5441 req-79b1338a-1d63-4ed3-bae1-486a4976571c service nova] Creating event network-vif-deleted:9a3872b5-a833-46a8-9c39-a7777f2a1371 for instance 3d827923-ffce-4e41-bb2e-7955767c159e on hv-cinder-84932 Sep 09 20:42:27.797008 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-c07498dc-3051-49e3-b7d3-b6a4181d5441 req-79b1338a-1d63-4ed3-bae1-486a4976571c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031226 Sep 09 20:42:27.797724 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 509/1028] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:42:27.855878 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:27.856491 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:27.863441 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:27.864425 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:27.864883 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:27.865692 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:27.866189 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:27.866612 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:27.939397 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:42:27.947099 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-10ac172f-fd63-40e1-8ba7-dcdb5d748522 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 200 len: 1225 microversion: 2.1 time: 0.095075 Sep 09 20:42:27.947664 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 520/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:27 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:42:28.972587 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:28.973303 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 3d827923-ffce-4e41-bb2e-7955767c159e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:28.979341 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:28.979816 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:28.980246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:28.980921 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:28.981405 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:28.981825 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:28.995325 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] HTTP exception thrown: Instance 3d827923-ffce-4e41-bb2e-7955767c159e could not be found. Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Request method failure captured: Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e HTTP/1.1 Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6OTvUtVijjpibOBC49igquZl2pvDbCohkxwWGQqNmiuhP45IIb0DzQoTr1pgZePjQKj1R_1-6i5c572v4oUw0vIOJtCAU5aZEJUOjBWC-Yruya2IeTRUlyaiOizDQSyXuuu3kO4tmgKCOHU5q_IuxZJ2oc8znLOJi2n3S9Eipkg6e4 Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:42:28.996887 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 63371d392c8c4b73939ee73a1627c8dd Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance 3d827923-ffce-4e41-bb2e-7955767c159e could not be found. Sep 09 20:42:28.998686 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': '3d827923-ffce-4e41-bb2e-7955767c159e'} Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d827923-ffce-4e41-bb2e-7955767c159e could not be found. Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:42:28.999695 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d827923-ffce-4e41-bb2e-7955767c159e could not be found. Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d827923-ffce-4e41-bb2e-7955767c159e could not be found. Sep 09 20:42:29.001407 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:29.003246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Returning 404 to user: Instance 3d827923-ffce-4e41-bb2e-7955767c159e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:42:29.003246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-210be841-6a6f-4b58-9585-5ce8c9990822 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e" status: 404 len: 111 microversion: 2.1 time: 0.030331 Sep 09 20:42:29.003246 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 510/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:28 2022] GET /compute/v2.1/servers/3d827923-ffce-4e41-bb2e-7955767c159e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:42:32.063947 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:32.064449 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:32.066107 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [req-ca1a898c-c0d5-4764-91dc-d4e257599f08 req-859c4532-a1c1-4302-8701-0f753ce7e52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea398be-0e07-4d50-86af-c37c921b8aca", "tag": "e4ac1fe9-a628-4015-bbd3-20c817809bdd"}]} {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:42:32.072169 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:32.072662 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:32.073089 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:32.074187 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:32.074958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:32.075549 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:32.077768 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ca1a898c-c0d5-4764-91dc-d4e257599f08 req-859c4532-a1c1-4302-8701-0f753ce7e52d service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:32.078243 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ca1a898c-c0d5-4764-91dc-d4e257599f08 req-859c4532-a1c1-4302-8701-0f753ce7e52d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:32.078665 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [req-ca1a898c-c0d5-4764-91dc-d4e257599f08 req-859c4532-a1c1-4302-8701-0f753ce7e52d service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:32.089984 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.compute.server_external_events [req-ca1a898c-c0d5-4764-91dc-d4e257599f08 req-859c4532-a1c1-4302-8701-0f753ce7e52d service nova] Creating event network-changed:e4ac1fe9-a628-4015-bbd3-20c817809bdd for instance 4ea398be-0e07-4d50-86af-c37c921b8aca on hv-cinder-84932 Sep 09 20:42:32.095047 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [req-ca1a898c-c0d5-4764-91dc-d4e257599f08 req-859c4532-a1c1-4302-8701-0f753ce7e52d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032687 Sep 09 20:42:32.095601 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 511/1031] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:42:32.103841 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Going to try to terminate instance {{(pid=120679) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 20:42:32.187189 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-69ad8641-d138-405e-92ab-a495a4f17847 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 204 len: 0 microversion: 2.1 time: 0.126649 Sep 09 20:42:32.189339 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 521/1032] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:42:32 2022] DELETE /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:32.198052 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:32.198738 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:32.206031 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:32.206518 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:32.206951 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:32.207673 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:32.208122 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:32.208536 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:32.342360 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:42:32.350235 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-27f88034-71d7-405a-a9b4-a37ba4e68387 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1578 microversion: 2.1 time: 0.157135 Sep 09 20:42:32.350806 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 512/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:32 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:33.375000 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:33.375827 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:33.382570 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:33.383054 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:33.383485 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:33.384183 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:33.384609 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:33.385024 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:33.517828 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.policy [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120679) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:42:33.525691 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-3e551da6-6367-41e4-b697-ba822ac66193 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1578 microversion: 2.1 time: 0.154895 Sep 09 20:42:33.526306 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 522/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:33 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:34.548943 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:34.549602 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:34.554009 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [req-f8da20fb-99ab-4456-b6ee-9e623124c8ba req-57cebdbe-962a-487a-9848-76034cf3ebf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea398be-0e07-4d50-86af-c37c921b8aca", "name": "network-vif-deleted", "tag": "e4ac1fe9-a628-4015-bbd3-20c817809bdd"}]} {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:42:34.556340 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:34.556868 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:34.557411 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:34.558188 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:34.558698 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:34.559190 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:34.563819 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f8da20fb-99ab-4456-b6ee-9e623124c8ba req-57cebdbe-962a-487a-9848-76034cf3ebf1 service nova] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:34.564544 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f8da20fb-99ab-4456-b6ee-9e623124c8ba req-57cebdbe-962a-487a-9848-76034cf3ebf1 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:34.564982 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [req-f8da20fb-99ab-4456-b6ee-9e623124c8ba req-57cebdbe-962a-487a-9848-76034cf3ebf1 service nova] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:34.576373 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.compute.server_external_events [req-f8da20fb-99ab-4456-b6ee-9e623124c8ba req-57cebdbe-962a-487a-9848-76034cf3ebf1 service nova] Creating event network-vif-deleted:e4ac1fe9-a628-4015-bbd3-20c817809bdd for instance 4ea398be-0e07-4d50-86af-c37c921b8aca on hv-cinder-84932 Sep 09 20:42:34.581377 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [req-f8da20fb-99ab-4456-b6ee-9e623124c8ba req-57cebdbe-962a-487a-9848-76034cf3ebf1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Sep 09 20:42:34.581966 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 523/1035] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Sep 9 20:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:42:34.628918 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.policy [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63371d392c8c4b73939ee73a1627c8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e12f0c37bd14176b04dfd87d7b10520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120680) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 20:42:34.637777 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-3aba49e7-ebf2-4985-81d7-4ac2f47198ed tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 200 len: 1391 microversion: 2.1 time: 0.093600 Sep 09 20:42:34.638344 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 513/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:34 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:35.663535 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:35.664236 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: 4ea398be-0e07-4d50-86af-c37c921b8aca] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:35.670420 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:35.670892 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:35.671325 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:35.672010 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:35.672459 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:35.673118 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:35.689359 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] HTTP exception thrown: Instance 4ea398be-0e07-4d50-86af-c37c921b8aca could not be found. Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Request method failure captured: Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca HTTP/1.1 Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6OTvUtVijjpibOBC49igquZl2pvDbCohkxwWGQqNmiuhP45IIb0DzQoTr1pgZePjQKj1R_1-6i5c572v4oUw0vIOJtCAU5aZEJUOjBWC-Yruya2IeTRUlyaiOizDQSyXuuu3kO4tmgKCOHU5q_IuxZJ2oc8znLOJi2n3S9Eipkg6e4 Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:42:35.690958 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 63371d392c8c4b73939ee73a1627c8dd Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance 4ea398be-0e07-4d50-86af-c37c921b8aca could not be found. Sep 09 20:42:35.692857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': '4ea398be-0e07-4d50-86af-c37c921b8aca'} Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea398be-0e07-4d50-86af-c37c921b8aca could not be found. Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:42:35.693777 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea398be-0e07-4d50-86af-c37c921b8aca could not be found. Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea398be-0e07-4d50-86af-c37c921b8aca could not be found. Sep 09 20:42:35.695192 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:35.696529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Returning 404 to user: Instance 4ea398be-0e07-4d50-86af-c37c921b8aca could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:42:35.696529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-88e69c88-0671-49b2-a26b-cf7f696a89f3 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca" status: 404 len: 111 microversion: 2.1 time: 0.034125 Sep 09 20:42:35.696529 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 524/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:35 2022] GET /compute/v2.1/servers/4ea398be-0e07-4d50-86af-c37c921b8aca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:42:36.136843 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:36.137399 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.compute.api [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120680) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:36.143899 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:36.144386 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:36.144826 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:36.146443 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:36.147100 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:36.147722 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG oslo_concurrency.lockutils [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:36.161821 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.wsgi [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] HTTP exception thrown: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Request method failure captured: Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: request: DELETE /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e HTTP/1.1 Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept: application/json Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Accept-Encoding: identity Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Connection: close Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Length: 0 Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Content-Type: application/json Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Host: 10.222.0.26 Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: Openstack-System-Scope: None Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: User-Agent: python-urllib3/1.26.12 Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Auth-Token: gAAAAABjG6OTvUtVijjpibOBC49igquZl2pvDbCohkxwWGQqNmiuhP45IIb0DzQoTr1pgZePjQKj1R_1-6i5c572v4oUw0vIOJtCAU5aZEJUOjBWC-Yruya2IeTRUlyaiOizDQSyXuuu3kO4tmgKCOHU5q_IuxZJ2oc8znLOJi2n3S9Eipkg6e4 Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Id: None Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Domain-Name: None Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Identity-Status: Confirmed Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Is-Admin-Project: True Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Id: default Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Domain-Name: Default Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Project-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Role: member,reader Sep 09 20:42:36.163463 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Roles: member,reader Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-Tenant-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Id: default Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Domain-Name: Default Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Id: 63371d392c8c4b73939ee73a1627c8dd Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: X-User-Name: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: method: > Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: exception: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.165132 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: action_args: {'id': 'ccc57f22-97e2-44fc-88b3-f5d9f124636e'} Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:42:36.166007 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.167535 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.169530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Returning 404 to user: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. {{(pid=120680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:42:36.169530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-323b979a-aefd-4d0a-9a99-314066057685 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 404 len: 111 microversion: 2.1 time: 0.031920 Sep 09 20:42:36.169530 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 514/1038] 10.222.0.26 () {58 vars in 1239 bytes} [Fri Sep 9 20:42:36 2022] DELETE /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:42:36.173684 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '>' {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:36.174313 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.compute.api [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] [instance: ccc57f22-97e2-44fc-88b3-f5d9f124636e] Fetching instance by UUID {{(pid=120679) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 20:42:36.180225 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:36.180711 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:36.181144 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:36.181857 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Acquiring lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:42:36.182347 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:42:36.182745 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG oslo_concurrency.lockutils [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Lock "7a4293c1-c873-423b-9687-2d61c3d59ab1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:42:36.198180 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.wsgi [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] HTTP exception thrown: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Request method failure captured: Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: request: GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e HTTP/1.1 Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept: application/json Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Accept-Encoding: identity Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Connection: close Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Length: 0 Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Content-Type: application/json Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Host: 10.222.0.26 Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: Openstack-System-Scope: None Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: User-Agent: python-urllib3/1.26.12 Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Auth-Token: gAAAAABjG6OTvUtVijjpibOBC49igquZl2pvDbCohkxwWGQqNmiuhP45IIb0DzQoTr1pgZePjQKj1R_1-6i5c572v4oUw0vIOJtCAU5aZEJUOjBWC-Yruya2IeTRUlyaiOizDQSyXuuu3kO4tmgKCOHU5q_IuxZJ2oc8znLOJi2n3S9Eipkg6e4 Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Id: None Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Domain-Name: None Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Identity-Status: Confirmed Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Is-Admin-Project: True Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Id: default Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Domain-Name: Default Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Project-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Role: member,reader Sep 09 20:42:36.200241 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Roles: member,reader Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7e12f0c37bd14176b04dfd87d7b10520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Id: 7e12f0c37bd14176b04dfd87d7b10520 Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-Tenant-Name: tempest-TestVolumeBootPattern-2130387938 Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Id: default Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Domain-Name: Default Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Id: 63371d392c8c4b73939ee73a1627c8dd Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: X-User-Name: tempest-TestVolumeBootPattern-2130387938-project Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: method: > Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: exception: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.202031 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: action_args: {'id': 'ccc57f22-97e2-44fc-88b3-f5d9f124636e'} Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: {{(pid=120679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:42:36.203213 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. Sep 09 20:42:36.204903 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: ERROR nova.api.openstack.wsgi Sep 09 20:42:36.206585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: DEBUG nova.api.openstack.wsgi [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Returning 404 to user: Instance ccc57f22-97e2-44fc-88b3-f5d9f124636e could not be found. {{(pid=120679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:42:36.206585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: INFO nova.api.openstack.requestlog [None req-b592e283-616b-49a1-8a50-246f6fb6642b tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e" status: 404 len: 111 microversion: 2.1 time: 0.031900 Sep 09 20:42:36.206585 dv-cinder-849325-4-iscsi devstack@n-api.service[120679]: [pid: 120679|app: 0|req: 525/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Fri Sep 9 20:42:36 2022] GET /compute/v2.1/servers/ccc57f22-97e2-44fc-88b3-f5d9f124636e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 20:42:37.497527 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: DEBUG nova.api.openstack.wsgi [None req-0f295e66-f24d-48e6-97f6-cedbc24069b4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] Calling method '.version_select at 0x7f4834a25790>' {{(pid=120680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:42:37.519136 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: INFO nova.api.openstack.requestlog [None req-0f295e66-f24d-48e6-97f6-cedbc24069b4 tempest-TestVolumeBootPattern-2130387938 tempest-TestVolumeBootPattern-2130387938-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1370114658" status: 202 len: 0 microversion: 2.1 time: 0.025364 Sep 09 20:42:37.520326 dv-cinder-849325-4-iscsi devstack@n-api.service[120680]: [pid: 120680|app: 0|req: 515/1040] 10.222.0.26 () {58 vars in 1263 bytes} [Fri Sep 9 20:42:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1370114658 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)